Introducing Ingest Processor: An Evolution in Splunk Data Management

Platform Poornima Devaraj

Splunk is pleased to announce the general availability of Ingest Processor, a Splunk-hosted offering within Splunk Cloud Platform designed to help customers achieve greater efficiencies in data transformation and improved visibility into data in motion. Ingest Processor joins Edge Processor, launched last year, to formalize Splunk’s Data Management portfolio, where we continue to invest in a multi-tenant cloud-based architecture to autoscale in response to increased workloads, and SPL2, our next-gen data search and preparation language that offers increased flexibility to shape data - all with an eye on cost-effectiveness.

With Ingest Processor, customers can easily filter, mask, enrich and otherwise transform data at the point of ingest, before routing it to supported destinations Splunk Cloud Platform, Amazon S3 and newly, Splunk Observability Cloud. Unique to Ingest Processor is that it enables a new capability – the conversion of logs to metrics in an effort to further optimize monitoring. Plus, given that this is a Splunk-hosted service, Ingest Processor is offered at two tiers — Essentials and Premier — depending on data processed volumes per day.

Customers now have a choice of deployment model – Edge Processor for those who require more control over data before it leaves their network boundaries and therefore need to host their own infrastructure, or Ingest Processor for customers all in on cloud, and distinctly, who want Splunk to manage the infrastructure for you. Furthermore, both pipeline processors can receive data from Splunk Universal and Heavyweight Forwarders, HEC and syslog.

Check out this video to see it in action.

Availability

At launch, Ingest Processor is available on Splunk Cloud AWS Victoria stacks upgraded 9.1.2312.202. It’s also CCF compliant, but don’t fret – PCI and HIPAA compliance are roadmap items coming soon.

It’s also available in a market near you, with plans for further regional expansion on the roadmap:

Get Started Today!

Managing data volumes is an integral part of a strong data strategy, and Splunk is here to help! To request activation in your environment, please contact your Splunk Account Team or complete this form. Include your company name, Splunk Cloud stack name, and Splunk Cloud region.

For more about Data Management and Ingest Processor, including release plans to support additional sources, destinations, and new functionality, see Splunk Docs for Ingest Processor and Splunk Docs for Splunk Cloud Platform.

Related Articles

Stream Your AWS Services Metrics to Splunk
Platform
2 Minute Read

Stream Your AWS Services Metrics to Splunk

Amazon Web Services (AWS) recently announced the launch of CloudWatch Metric Streams. Cloudwatch Streams can stream metrics from a number of different AWS resources using Amazon Kinesis Data Firehose to target destinations. What this means for current Splunk customers is they now have the option of either using the Splunk add-on of AWS to poll metrics or to make use of this new service and let Amazon Kinesis Data Firehose push metrics to a Splunk HEC endpoint, and reduce their latency by anywhere between 5 to 10 minutes.
Making Machine Data Easier to Onboard, Prepare and Trust with AI-Powered Data Management
Platform
10 Minute Read

Making Machine Data Easier to Onboard, Prepare and Trust with AI-Powered Data Management

AI-Powered Data Management helps teams turn raw, changing machine data into trusted, usable signals faster.
A Deeper Dive into Machine Learning at Splunk
Platform
2 Minute Read

A Deeper Dive into Machine Learning at Splunk

Ever wondered where to get started with machine learning at Splunk? This blog contains links to deep dives that provide end-to-end guides for how to implement specific use cases against your own data.