Elasticsearch Authentication Failure

The collector’s log indicates failed to bootstrap elasticsearch and unable to authenticate user [<username>] for REST request

SYMPTOM

The collector's log indicates a message similar to the following:

2023-09-23T18:05:19.604Z        error   bootstrapper[elasticsearch]     elasticsearch/bootstrap.go:147  failed to bootstrap elasticsearch. retrying...  {"code": "elasticsearch/bootstrap-failure", "reason": "error while creating default ilm policy - GET ilm policy error for ilm policy 'elastiflow'- status code 401 not expected - {\"error\":{\"header\":{\"WWW-Authenticate\":[\"Basic realm=\\\"security\\\" charset=\\\"UTF-8\\\"\",\"Bearer realm=\\\"security\\\"\",\"ApiKey\"]},\"reason\":\"unable to authenticate user [xxxxZZelastic] for REST request [/_ilm/policy/elastiflow]\",\"root_cause\":[{\"header\":{\"WWW-Authenticate\":[\"Basic realm=\\\"security\\\" charset=\\\"UTF-8\\\"\",\"Bearer realm=\\\"security\\\"\",\"ApiKey\"]},\"reason\":\"unable to authenticate user [xxxxZZelastic] for REST request [/_ilm/policy/elastiflow]\",\"type\":\"security_exception\"}],\"type\":\"security_exception\"},\"status\":401}"}
github.com/elastiflow/flowcoll/pkg/outputs/elasticsearch.(*Bootstrap).Run
        /tmp/flowcoll/pkg/outputs/elasticsearch/bootstrap.go:147
github.com/elastiflow/flowcoll/pkg/outputs/elasticsearch.NewCreateInstanceFunc.func1
        /tmp/flowcoll/pkg/outputs/elasticsearch/instance_registration.go:155
github.com/elastiflow/flowcoll/pkg/instantiator.(*Instantiator).Run
        /tmp/flowcoll/pkg/instantiator/instantiator.go:79

PROBLEM

The collector's Elasticsearch output is unable to authenticate with the Elasticsearch host(s) specified in EF_OUTPUT_ELASTICSEARCH_ADDRESSES.

SOLUTION

Ensure that EF_OUTPUT_ELASTICSEARCH_USERNAME or EF_OUTPUT_ELASTICSEARCH_PASSWORD has been entered correctly. Providing the correct username and password will correct this error. You can test the username and password manually using curl. For example:

curl -XGET https://127.0.0.1:9200/_cat/indices -u username:password --insecure

REFERENCE

• EF_OUTPUT_ELASTICSEARCH_USERNAME

• EF_OUTPUT_ELASTICSEARCH_PASSWORD