Data Fusion Engine 2.2.2
Data Fusion Engine
Land it. Use it. Scale it.
What you used Splunk, Elastic and a lakehouse for, without the limitations. Gigabytes to petabytes. Your environment, your control.
Quickstart
Run DFE locally
- Demo
- Docker
- Kubernetes
- AWS
See DFE working on your laptop, with sample firewall logs already flowing in.
Needs Docker Engine 26.0 or later with Compose 2.34.0 or later.
docker compose -f oci://ghcr.io/hyperi-io/dfe-docker:demo up -d
Then point your browser to http://localhost:3000.
The demoThe whole DFE stack on one machine, ready for your own data.
Needs Docker Engine 26.0 or later with Compose 2.34.0 or later.
docker compose -f oci://ghcr.io/hyperi-io/dfe-docker:compose up -d
Then point your browser to http://localhost:3000.
Docker quickstartRun DFE on your own Kubernetes cluster, on-premises or managed, with every change going through Git.
Kubernetes quickstartBuild a DFE stack in your own AWS account, sized to your data.
AWS quickstartWhy DFE
Eight principles, one platform
They run through everything we build.
Day one
Effective from day one
Schemas, pipelines and dashboards come ready. Your data works when it arrives, and you tune from there.
Context
Fused with context
Every event is joined to what surrounds it: the user, the device, the place, what changed. You get the whole story, not another bucket of logs to dig through.
Edge
Do the work at the edge
Filter, shape and enrich data where it is born, so you move and store only what is worth it.
Efficiency
Efficiency, efficiency, efficiency
More data on less hardware, kept for longer. The answer from six months ago is still there, and you can afford to find it.
Scale
Built for petabytes, made small
Designed and tested at petabyte scale, then brought down to a single box. Growing is what it was made for.
Integration
Plays nicely, or replaces
Filebeat, Logstash, Vector, Fluent Bit and OpenTelemetry send straight in. Run it beside your current tools, or move across completely.
Sovereignty
Sovereign or secure enclave by design
Runs in your data centre, your own cloud account, or a network with no outside connection. No HyperI cloud sits in the path.
GitOps
GitOps from the start
Every change is a commit to your own deploy repo, with history, and peer review through pull requests in production.
Deploy
Where it runs
One box to a cluster, with the same images and config all the way.
Updates
What's new
Latest release
DFE 2.2.2
What changed in this release, from the dfe-infra release notes.
Release notesDeploy
DFE on AWS
Your own AWS account, on Graviton, from one short wizard.
Read the guideReference
HTTP API reference
Every dfe-engine endpoint, generated from the OpenAPI spec this release ships.
Browse the API
Start with the demo
One host with Docker. Live firewall syslog comes in, and each vendor's lines land parsed in their own ClickHouse table.