Working With Ingest Pipelines In ElasticSearch And Filebeat

Published on Author gryzli

What are ingest pipelines and why you need to know about them ? Ingest Pipelines are powerful tool that ElasticSearch gives you in order to pre-process your documents, during the Indexing process. In fact they are integrating pretty much of the Logstash functionality, by giving you the ability to configure grok filters or using different… Continue reading Working With Ingest Pipelines In ElasticSearch And Filebeat

Tuning Ansible For Maximum Performance

Published on Author gryzli

I hate stuff running slow and I love Ansible.  In this guide, I will share how achieved more than 50x speedup for executing simple ansible playbooks (which are meant to be fast , but they was not ).   Measuring Ansible Tasks Execution Time Before optimizing whatever it is, we should have some good baseline… Continue reading Tuning Ansible For Maximum Performance

Advanced Filebeat Configuration

Published on Author gryzli

If you have made it through the initial filebeat installation , you may want to do some more interesting stuff with Filebeat. Here I will share some of my experience with it.   Configuring Filebeat To Tail Files This was one of the first things I wanted to make Filebeat do. The idea of ‘tail‘… Continue reading Advanced Filebeat Configuration

Installing And Configuring Filebeat On Centos/RHEL

Published on Author gryzli

Filebeat is a perfect tool for scraping your server logs and shipping them to Logstash or directly to ElasticSeearch. You will find some of my struggles with Filebeat and it’s proper configuration.   Installing Filebeat under Centos/RHEL As with all ELK products the installation process is really easy and straight forward. Filebeat could be easily… Continue reading Installing And Configuring Filebeat On Centos/RHEL

Linux Admin Daily Usage

Published on Author gryzli

Shell   Calculate the size of all files from a given type/extension Recently I need something for doing such calculations and end up with the following command line (found on stackexchange), which will calculate the size summary for all “*.jpg” files in “some_directory”.

    Using Linux moreutils  Recently I found out the existence… Continue reading Linux Admin Daily Usage

ElasticSearch CheatSheet

Published on Author gryzli

ElasticSearch Example Queries  Searching with wildcard query.   Changing the size of the search result to 100 items. 

Filter aggregations by minimum document count in the result by using min_doc_count setting.

Check cluster health information

Check cluster settings

Check index mappings and settings

Check indexes recovery stats

Check shard… Continue reading ElasticSearch CheatSheet

ElasticSearch Security – Installing And Configuring Search-Guard How-To

Published on Author gryzli

Security is one of the major “missing” things from the free ELK Stack compilation, so let’s talk about achieving it! Soon or later there will come time, when you may want some more “Secure” ElasticSearch cluster, and by “Secure” I mean some of the following : Encrypted communication between cluster nodes Encrypted communication between “Indexing… Continue reading ElasticSearch Security – Installing And Configuring Search-Guard How-To

ElasticSearch Choosing Field Mappings

Published on Author gryzli

If you want to spend good time with ElasticSearch you must choose very carefully your elasticsearch index field mappings. Proper field mappings are extremely important in order to be able to search properly inside your data. Keep in mind that ElasticSearch differs a lot between major versions. The current article is written for the current… Continue reading ElasticSearch Choosing Field Mappings

How ElasticSearch Works (Basic Concepts)

Published on Author gryzli

I’m going to skip the intro about Elasticsearch and it’s primary application (which is for search) and will go straight to the point. If you need some basic understanding of what is Elasticsearch and how to use it, I suggest you to start with the official documentation which is one of the best software documentations… Continue reading How ElasticSearch Works (Basic Concepts)

WordPress WP GDPR Compliance Privilege Escalation Exploit

Published on Author gryzli

Two days ago (on November 08 2018) nasty WP exploit has been identified inside the popular GDPR wordpress plugin , that leads to privilege escalation.  The plugin has more than 100 000 active installations.  All versions prior 1.4.3 (except 1.4.3) are vulnerable to the exploit.    What is the actual vulnerability ?  More information about… Continue reading WordPress WP GDPR Compliance Privilege Escalation Exploit