AWS Classic

Pulumi Official
Package maintained by Pulumi
v5.9.1 published on Tuesday, Jun 21, 2022 by Pulumi

Twitter Search in Athena

View Code Deploy

A sample project that queries Twitter every 2 minutes and stores the results in S3. The project also sets up an Athena table and query. This project demonstrates using aws.cloudwatch.EventRule to run a Lambda on an interval.


Register a new Twitter app.

Deploy and run the program

  1. Create a new stack:

    pulumi stack init twitter-athena
  2. In Twitter, get the keys for your application. Set configuration values for your Twitter consumer key/secret and application key/secret. Use the --secret flag to securely encrypt secret values.

    pulumi config set twitterAccessTokenKey <Value for Consumer Key (API Key)>
    pulumi config set --secret twitterAccessTokenSecret <Value for Consumer Secret (API Secret)> 
    pulumi config set twitterConsumerKey <Value for Access Token>
    pulumi config set --secret twitterConsumerSecret <Value for Access Token Secret>
  3. Set a search term to query for:

    pulumi config set twitterQuery "Amazon Web Services"
  4. Set the AWS region:

    pulumi config set aws:region us-west-2
  5. Restore NPM modules via npm install.

  6. Preview and run the deployment via pulumi up. A total of 16 resources are created.

  7. Run pulumi stack output to view output properties (or view the stack on

    $ pulumi stack output
    Please choose a stack: aws-serverless-js-twitter-dev
    Current stack outputs (4):
        OUTPUT                                           VALUE
        athenaDatabase                                   tweets_database
        bucketName                                       tweet-bucket-de18828
  8. Navigate to the URL for createTableQueryUri and run the query in the Athena console. This will create a table called tweets.

  9. Navigate to the URL for topUsersQueryUri and run the query in Athena. You’ll see tweets for your search term, by users with more than 1000 followers.

    Athena console

Clean up

To clean up resources, run pulumi destroy and answer the confirmation question at the prompt.