Discover Spoon Consulting tips and acuality on the Elastic Search tools, use cases and implementation.
Elasticsearch is very powerful for non-structured text classification. In a recent use case for an important international Consulting Company, we had to exploit non-structured documents to allow our client to exploit his internal data, be able to analyse and find similar content, based on a tag classification. That’s typically a case where Elasticsearch can look magic. In just a few days, based on the core functionality of Elasticsearch and Kibana, we were able to auto-classify all the documents of the…
Read MoreIn the latest releases of Elasticsearch and Kibana, a lot has been done to integrate runtime fields smoothly and unleash all it’s power naturally. In a few clicks, you can create virtual values for formatting or calculating values without reindexing the whole index. The runtime field can now be called in total transparency like any other elasticsearch _source field. But it’s still a virtual field, calculated on the fly at query time, just like scripted fields. So, it’s a very…
Read MoreTL:DR New aggregation on unstructured (semi-structured) texts with the 7.16 Categorize logs for an alerte Better granularity for information message Build Better Alerts with the new aggregation of Elasticsearch We are working on an alerting system for one of Spoon Consulting clients on Elasticsearch. Client needs are very classical : Send an alert when I have more than 5 error logs within less than 10 min Know encountered errors Usually to do this I would have to build a query…
Read MoreTL:DR After an awful update of physical RFID readers, a connected manufactory started to generate histories in a continious mode instead of a sequential mode This lead to hundreds of thousands duplicates in the history database With one Elasticsearch aggregation and one small Rails script, it was easy to clean up both elasticsearch and Postgre database Management of Histories with Elasticsearch In this project, we use The Audit gem of Ruby on Rails to track any change on the main…
Read MoreExpat.com is the benchmark platform for people living abroad. He plays a large role: Help futur expats to prepare to settle in their host country; Help expats to handle their daily problems; Allow members to build networks, both professional and personal in their new place of life; Provide content on their new area of residence and on life abroad in general (expatriation guides, magazine dedicated to expatriation); Recommend service providers adapted to the needs of those living abroad, list the…
Read MoreExpat.com est la plateforme de référence de la vie à l’étranger. Son rôle est multiple : Aider les futurs expats à préparer leur installation dans leur pays d’accueil ; Aider les expats dans leurs problèmes du quotidien ; Permettre aux membres de se constituer un réseau, tant professionnel que personnel dans leur nouveau lieu de vie ; Apporter du contenu sur leur nouvelle zone de résidence et sur la vie à l’étranger en général (guides de l’expatrié, magazine dédié à…
Read MoreSalesforce and Elasticsearch are two of the main enterprise tools on the market.Many companies use both and need to build bridges between them.In this article we will see how to ingest Salesforce’s data into an Elasticsearch cluster. TL:DR Connect your logstash with the Logstash Salesforce’s Input Get each objects in salesforce one by one Consolidate your data with an extra step Salesforce in Elasticsearch With more than one hundred Salesforce Projects, at Spoon Consulting we faced a lot of uses…
Read MoreElastic offer a lot a new features and incredible solutions for years. With the version 7, the company has accelerated innovation a lot with security, data streams, searchable snapshots, and so on. For engineers passionnated in Elasticsearch like we are at Spoon, it sound almost like an evidence. Discover official Elastic’s announcement on the link below: https://www.elastic.co/fr/culture-elastic-named-in-fast-companys-2021-worlds-most-innovative-companies-list
Read MoreElasticsearch has a lot of small unknown game changing features. Search templates are one of those. When it suits your use case, it changes a lot your integration quality TL:DR Elasticsearch’s Search Template are interesting for : Simplify integration Give a standard access to your indices without having to create any microservice Separation of concerns Avoid code duplication What is a Search Template? Search templates are reusable scripts that handle the query complexity and let integrator use very complicated queries…
Read MoreAs we saw in part 1, we can use boolean queries to influence scoring and boost the relevance of your searches. But it soon becomes very verbose and some kind of queries can be quite complicated to write. Multi-match comes to help you write more concise search Queries. TL:DR Terms can be reused to “boost” better results – in part 1 Filter can be used to scope a query without influencing the score – in part 1 Mix Must/Should/Filter in one Elasticsearch…
Read More