Ingesting Cloudflare Logs with DataSet

Introduction

This article explains how to configure Cloudflare to upload logs to AWS S3 with a Logpush job, then import those logs to DataSet with our S3 integration.

Configuration

There are two items to configure in Cloudflare:

Configure a destination S3 bucket for your web application

https://developers.cloudflare.com/logs/logpush/logpush-dashboard/

Enable an S3 bucket for Logpush job

https://developers.cloudflare.com/logs/logpush/aws-s3/

Configure S3 imports in DataSet

Follow our documentation on importing logs from an S3 bucket to ingest the data to DataSet.

Once the configuration has been completed, turn on the Logpush job. After a short initial delay, Cloudflare logs will become available to your DataSet account.

Inspect Cloudflare logs in DataSet