Transofrming and Enriching Data
Creating a Parser Strategy.
Parsing has been the bread and butter of SIEMs and APMs from the start. First, there were collectors to get the data into the system. Then there came a library of parsers, as there were no standards. Now, there are nuances that make records break. This is a complex that needs a strategy to deploy, maintain, and scale.
- Address Parsing Complexity.
- It is almost impossible to create a single parsing approach to a stream of data.
- Build in Sub Processors.
- Divide the problem into manageable components. Fluency has prebuilt parsers for common patterns.
- Trap Issues.
- There are clean ways to trap errors to allow for trapping samples to address when the parse fails.
GitHub OpenSource Library
Accelerate Deplyment
Don't work alone. Fluency has a strong collection of documentation, but alsoa large collection of code examples on our Github repository.
- Fluency Processing Language.
- Fluency uses the Fluency Processing Language, which is a subset of JavaScript and GoLang.
- Modular.
- Code addresses a phase of the data flow process. In this manner, the complexity of connecting to data sources and data sinks are separated from the parsing and routing.
- Tons of Examples.
- The Git Repository is to make life easier. These are code snippets that are in use and address many of the most common flow needs.
