Docs
test1test2
6.5
6.5
  • ElastiFlow Documentation
  • Unified Flow Collector
    • General Configuration
    • Changelog
    • Maxmind GeoIP2 and GeoLite2
    • RiskIQ PassiveTotal
    • Network Interfaces
    • User-Defined Metadata
    • Docker
    • Linux
    • Unified Flow Collector Introduction
    • System Requirements
    • Supported IEs
    • AWS VPC Flow Log IEs
    • IPFIX IEs
    • Netflow IEs
    • sFlow IEs
  • Unified SNMP Collector
    • Device Groups
    • Changelog
    • Devices
    • Downloading Definitions
    • Enumerations
    • Objects
    • Object Groups
    • User-Defined Metadata
    • Docker
    • Network Interfaces
    • United SNMP Collector Introduction
    • Linux
    • Scheduling Rediscovery
  • Monitoring ElastiFlow
    • Liveness & Readiness
    • Metrics
    • Prometheus & Grafana
  • Configuration Reference
    • YAML Configuration Files
    • Configuration Reference Overview
    • Common
      • API
      • Licensing
      • Overview
      • Logging
      • HTTP output
      • Elasticsearch output
      • Kafka output
      • Monitor output
      • OpenSearch output
      • Splunk output
      • stdout output
      • Processor
    • Unified Flow Collector
      • Overview
      • Community/Conversation IDs
      • EF_PROCESSOR_ENRICH_TOTALS_IF_NO_DELTAS
      • Overview
      • RiskIQ PassiveTotal
      • Maxmind
      • User-Defined Metadata
      • Overview
      • Overview
      • User-Defined Metadata
      • Overview
      • Benchmark Input
      • Netflow/IPFIX/sFlow (UDP)
      • Licensing
      • Decoder/Processor
      • Sample Rate
      • Configuration Changes
    • Unified SNMP Collector
      • User-Defined Metadata
      • Overview
      • Licensing
      • SNMP Poller
      • EF_PROCESSOR_SNMP_ENUM_DEFINITIONS_DIRECTORY_PATH
  • API Reference
    • API Reference Overview
    • SNMP Operations
  • Data Platforms
    • Elastic
      • Basic Cluster
      • Advanced Cluster
      • Single Server
      • Multi-Tier Cluster
      • Single "Lab" Server
      • Elasticsearch
      • ElastiFlow vs. Filebeat and Logstash
      • RHEL/CentOS
      • Ubuntu/Debian
      • Kibana
      • ML
        • Network Security
        • Machine Learning
        • Availability
          • Network Availability
          • DHCP
          • LDAP
          • DNS
          • NTP
          • RADIUS
          • TCP Sessions
        • Network Security Activity
          • Rare Autonomous System
          • Network Activity
          • Rare Conversation
          • Rare Geolocation
        • Network Security Brute Force
          • Brute Force CLI Access
          • Brute Force Remote Desktop Access
          • Brute Force Attacks
        • Network Security DDoS
          • Denial-of-Service
          • ICMP Flood Attack
          • SYN Flood Attack
          • TCP DDoS Attack
          • UDP Amplification Attack
        • Network Security Recon
          • ICMP Scan
          • Reconnaissance
          • Port Scan
        • Performance
          • Unusual ASN Traffic Volume
          • Unusual Network Interface Traffic Volume
          • Network Performance
    • Opensearch
      • Dashboards
      • Auth Sig V4
    • Splunk
      • Default Search Macro
      • Configuring Data Input & Index
      • Splunk App Installation
    • Output Configuration
  • Additional Guides
    • Catalyst (sFlow)
    • FortiGate
    • hsflowd
    • Configuring Flow Sampling on Juniper Routers
    • Junos OS (sFlow)
    • MikroTik RouterOS
    • OpenWRT (softflowd)
    • Ubiquiti EdgeRouter
    • SonicWall
    • Junos OS
    • Extending SNMP Device Support
    • Flow Device Support Overview
    • SNMP Device Support Overview
    • Generating A Support Bundle
  • FAQ
    • Flows stopped showing up in Kibana (Disk(s) Full)
    • Common reasons why you have discrepancies between ElastiFlow data & reality
    • What Are Snapshots?
    • Importing the wrong dashboards (No data)
  • Knowledge Base
    • Config
      • Elasticsearch Authentication Failure
      • CA Certificate Path Incorrect
      • license/error Invalid Segments
    • Flow
      • Bidirectional Flow Support
      • Configure the UDP Input
      • Flow Records Not Received
      • Netflow v9/IPFIX Template Not Receieved
      • Unsupported sFlow Structures
    • General
      • License Has Expired
      • License Agreement Not Accepted
    • Install
      • .deb Upgrade Fails File Overwrite
    • Operation
      • Flow Collector Queues 90% Full
      • Dashboard Updates
      • Change elastiflow-* Index Name?
  • Elastic Stack Deployment
  • Download Links
Powered by GitBook
On this page
  1. Data Platforms
  2. Elastic
  3. ML

Machine Learning

PreviousNetwork SecurityNextAvailability

import DocCardList from '@theme/DocCardList';

ElastiFlow offers a suite of anomaly detection jobs specifically tailored for Elasticsearch's machine learning framework. These jobs are meticulously designed to safeguard and enhance network performance, availability, and security. By integrating seamlessly with Elasticsearch, ElastiFlow utilizes the platform's advanced machine learning capabilities to continuously monitor and analyze network traffic and performance metrics. This integration enables ElastiFlow to detect a wide range of anomalies - from unusual traffic patterns that could indicate performance bottlenecks, to subtle signs of security threats like network intrusions or data breaches.

Downloads

Schema
Link

CODEX

ECS

:::tip If you wish to import all of the available ElastiFlow-provided anomaly detection jobs, the above downloads are exactly what you are looking for. :::

Elasticsearch ML Framework

Elasticsearch, includes advanced anomaly detection capabilities within its machine learning framework, providing a powerful tool for monitoring and maintaining network performance, availability, and security. Its uses sophisticated machine learning algorithms to analyze data patterns and identify anomalies. This approach is particularly effective because it adapts to the changing behavior of data over time, providing a dynamic and accurate detection mechanism. It can spot unusual trends, spikes, or drops in metrics that could indicate problems.

One of Elasticsearch's strengths is its ability to perform real-time analysis. This is vital for network systems where immediate detection of issues such as traffic surges, performance bottlenecks, or security breaches can prevent significant disruptions or damage.

The platform's use of unsupervised learning means it can identify anomalies without having been explicitly programmed to look for specific issues. This capability is crucial in detecting unknown or emerging threats and issues, which are not yet understood or have not been previously encountered. Anomalies are scored based on their severity, allowing network administrators to prioritize issues for investigation and response. The system can also be configured to send automated alerts in response to detected anomalies, ensuring that potential problems are addressed promptly.

The anomaly detection jobs provided by ElastiFlow are crucial for preemptively identifying potential issues, allowing network administrators to take timely actions to maintain optimal network health. By leveraging this powerful combination, ElastiFlow empowers organizations to proactively manage their networks, ensuring they remain robust, available, and secure against an ever-evolving landscape of network challenges and threats.

All ML Jobs for CODEX Schema
All ML Jobs for ECS Schema