“In-place search” Observability data at the edge, In-motion, In-observability S3 data lake, and In-Timeseries Log Stores with new Search-> Collect -> Store pipelines
PLEASANTON, Calif., Nov. 17, 2022 /PRNewswire/ — Building on its release of the Composable Analytics for Observability and AIOps, CloudFabrix, the Data-centric AIOps Leader, and inventor of Robotic Data Automation Fabric Platform, today announced the availability of Composable Search and Log Intelligence as a service (LIaaS) to reduce Security Information and Event Management(SIEM) costs and Mean Time to Resolve(MTTR). This furthers our vision of unifying Observability, AIOps, and Automation.
The rise of Edge Computing and Multi-cloud deployment has exacerbated the challenges around the 4V’s of the data – Volume, Velocity, Veracity, and Variety. The traditional approach of Collect ->Store ->Search results in data stores results in data swamps, due to repetitive and redundant data, without many actionable insights. Traditional search tools need data to be ingested, indexed, and then searched using proprietary query languages, creating data silos. These tools are complex and fall short when collecting data across disparate data sources, data formats, and data types as needed by Composable Decision boards, Composable Services, and Composable Pipelines.
A Composable In-place Search is a transformational approach that enables a new Search -> Collect and -> Store paradigm from the traditional Collect-> Store and -> Search. Some of the benefits Composable Search provides are
- Faster Time to Insights and actions – The right data is discovered, searched, visualized, and then either presented as Composable decision boards or alert notifications.
- Reduce Complexity and Cost – associated with collecting, moving, indexing, storing, and then searching the data, increasing the TCO.
- Remove data silos – Low Code / No Code bots invoke a universal query language that can “In-place search” at the edge, across an observability data lake, any time-series database, or custom search tools like Splunk, Elastic, and others at the same time and aggregate data.
- Ease of use – Low Code / No Code bots make it easy for any Citizen developer to use search. Users can create search pipelines using RDA Studio, RDA Pipeline builder or simply using CLI commands.
- Work with any data type – Leverages patent-pending Robotic Data Automation Fabric Platform, which enables Data Integration and Ingestion, Data Filtering, and Transformation on Datasets, Dataframes, Dependency Mappings, Service tickets, Persistent Streams, and more using Low Code/No Code bots
Log Intelligence as a Service, is very effective in implementing cyber security mandates for log retention, and preventing security breaches by optimizing Security Incident and Event Management (SIEM), predictive business analytics, incident response, cloud automation, and orchestration.
Common practice is to collect and analyze logs to make a system observable, as log files contain most of the data from full-stack alerts and events. Existing Log Analytics solutions ingest repetitive and redundant data which drives licensing TCO exorbitantly high, drives compute and storage infrastructure costs, and most importantly results in poor MTTI and MTTR.
Log Intelligence overcomes these challenges, by reducing TCO by 40-80%, improving MTTI/MTTR by over 60% and productivity by over 40% as follows
- Edge IoT, In-place Search – Composable Search compliments Log Intelligence service. Collect and stores only valuable data as a full-fidelity copy in Observability Data Lake and In-place search as needed on security breaches and compliance needs
- Log Ingestion – Bring your own Log Tool (BYOL) and ingest data in pull/push/batch modes
- Log Reduction and Replay – Up to 40-80% log volume reduction using correlation techniques and replay using UTC timestamps, IP addresses, and certain patterns, to your choice of stream
- Log Routing – Aggregate logs, normalize, transform, enrich, and route to multiple locations – Data Lakes, log stores, analytic platforms, Composable dashboards, and more.
- Log Enrichment – Enrich logs using Geo-IP or DNS lookups from Infoblox, CVE (Common Vulnerability and Exposure) feeds, TIP (Threat Intelligent Platform) feeds
- Log Predictive Analytics – Convert logs into metrics and use a number of regression AI/ML models for anomaly detection
Learn more about Composable Search and Log Intelligence as a service at AWS re:Invent 2022 – Nov 28th-Dec 1st and at our upcoming on-demand webinar “Reduce your SIEM costs and improve MTTR by over 50% on December 8th 2022 “
“Cloudian’s Hyperstore object storage integrates with CloudFabrix’s Composable In-place Search and Analytics to provide a limitlessly scalable and highly secure Observability Data Lake and Log Intelligence solution,” said Larry Meese, Vice President of Products and Solutions, Cloudian. “As a result, customers no longer have to compromise on operational data and can keep a full-fidelity copy of this data in a low TCO, searchable hybrid data lake. This joint solution will be showcased at AWS re:Invent 2022 – Nov 28th-Dec 1st“
“Enterprise IT is undergoing the next transformative technology shift which is impacting multiple verticals, thanks to IoT, 5G Edge, and AI,” said Dr. Ganesh Sundaram, founder of AlefEdge, and a leading innovator in the edge tech category. He added, “as we enter the Exabyte era, autonomous and automated edge AI platforms promise to deliver exponential gains while enabling multiple use cases in many industries. CloudFabrix’s Composable In- place search and programmable EdgeAI workflow orchestration approach, is timely and will be a significant contributor towards a massive edge-first economy.”
“Composable Search is a new search->collect->store paradigm for the cloud-native era, delivered as part of our patent pending Robotic Data Automation Platform, said Shailesh Manjrekar, Vice President of AI and Marketing at CloudFabrix”. He added, “Composable Search and Analytics enables multiple use cases, including Log Intelligence and Data Observability management. Our vision is to build a best of breed eco-system around this use case”.
CloudFabrix is the leading Data-centric AIOps Platform vendor and the inventor of Robotic Data Automation Fabric (RDAF). RDAF delivers integrated, enriched and actionable data pipelines to operational and analytical systems. RDAF unifies Observability, AIOps, and Automation for Operational Systems and enriches analytical systems. CloudFabrix empowers Business and IT leaders with AI-powered actionable intelligence to make faster and better decisions and accelerate IT planning and Autonomous operations. For more information, visit https://cloudfabrix.com/