Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Create a Cloud Logging Sink

...

Create Sink 1Image ModifiedCreate Sink 2Image Modified

  • First, create a Pub/Sub topic in a project that will be used by the logs routing sink:

    • In the GCP console, switch to the project where you will create the Pub/Sub topic

      • If creating a logs routing sink at the organization or folder level, this should be your Data Theorem integration project

      • Otherwise it can be in the same project as where you plan to create the sink

    • Using the left-hand side menu, select Pub/Sub (in the Analytics section), and then select Topics

    • Click on Create Topic

    • Use datatheorem-logs-processing as the topic ID, and uncheck "Add a default subscription"

      • No other options are needed

    • Click Create to create the topic

  • Next, create the logs routing sink:

    • If creating the sink at the organization (or folder) level, switch from the project to your organization (or folder)

    • Using the left-hand side menu, select Logging (in the Observability section), then within the Configure subsection, select Log router

    • Click on Create Sink

    • In the Sink details section, input datatheorem-logs-processing as the sink name, and click Next

    • You will have to fill in the full ID of the sink destination. For a Pub/Sub topic, it must be formatted as (but replace the [PROJECT_ID] and [TOPIC_ID] with the topic's information): pubsub.googleapis.com/projects/[PROJECT_ID]/topics/[TOPIC_ID]

    • Click Next

    • In the Choose logs to include section, add the following inclusion filter: resource.type="http_load_balancer"

      • You can click on Preview logs to see which logs will be included

    • Complete the sink creation by clicking on Create sink

...