1. Serverless Image Processing for AI with GCP Cloud Functions


    To create a serverless image processing system using AI on Google Cloud Platform (GCP), we will use Pulumi to define the infrastructure. We will set up a Cloud Function that will be invoked whenever an image is uploaded to a Cloud Storage bucket. This function will call Google's AI services to process the image and store the results in another Cloud Storage bucket.

    Here's how the components interact:

    • Cloud Storage Buckets: One bucket for uploading the raw images and another for storing processed results.
    • Cloud Functions: To execute the image processing logic whenever an image is uploaded to the input bucket.
    • Pub/Sub: Optionally, we can use a Pub/Sub topic to decouple image analysis requests from the processing function, although it's not strictly necessary for a simple workflow. For a more complex system involving multiple steps or services, this could be beneficial.

    We'll create two main resources using Pulumi:

    1. Google Cloud Function: Listens to the bucket's finalize event, which indicates that a new file has been uploaded.
    2. Google Cloud Storage Buckets: Two buckets, where one is for the uploads and another is for storing the processed data.

    Below is the Pulumi Python program that sets up this infrastructure:

    import pulumi import pulumi_gcp as gcp # Name your buckets raw_images_bucket_name = "raw-images-bucket" processed_images_bucket_name = "processed-images-bucket" # Create GCP Cloud Storage Buckets to store raw and processed images raw_images_bucket = gcp.storage.Bucket(raw_images_bucket_name) processed_images_bucket = gcp.storage.Bucket(processed_images_bucket_name) # Generate a Google Cloud Function that gets invoked when a new image is uploaded to the raw images bucket. # The cloud function will utilize Google's AI services (e.g., Cloud Vision API) to process the image # and store results in the processed images bucket. # Note that you would have to replace the 'process_image' placeholder with your own Python function # code that performs the image processing utilizing Google's AI services. image_processor_function = gcp.cloudfunctions.Function("imageProcessorFunction", entry_point="process_image", runtime="python37", # Make sure to choose the correct runtime version for your function. source_archive_bucket=raw_images_bucket.name, source_archive_object=f"{raw_images_bucket.name}/source.zip", # Upload your function source code as a zip file. trigger_http=True, # Setting trigger_http to false will make this function respond to internal GCP events (such as a bucket upload). environment_variables={ "PROCESSED_IMAGES_BUCKET": processed_images_bucket.id, }, ) # IAM member to give the cloud function permission to interact with the Cloud Storage Buckets bucket_object_admin_role = gcp.storage.IAMMember("bucketObjectAdminRole", bucket=processed_images_bucket.id, role="roles/storage.objectAdmin", member=pulumi.Output.concat("serviceAccount:", image_processor_function.service_account_email), ) # The URL that the Cloud Function can be invoked at (if you choose to invoke it directly via HTTP) pulumi.export("image_processor_function_url", image_processor_function.https_trigger_url)


    Cloud Storage Buckets:

    • raw_images_bucket: This bucket is used to upload raw images that need processing.
    • processed_images_bucket: Here we'll save processed images or any metadata extracted by the AI services.

    Cloud Function:

    • imageProcessorFunction: This Google Cloud Function is set up to be triggered whenever a new object is finalized (uploaded) in the raw_images_bucket.


    • bucketObjectAdminRole: This IAM role ensures that the Cloud Function has the necessary permissions to read from the raw images bucket and write to the processed data bucket.


    • We export the HTTPS trigger URL of the Cloud Function, which can be used to invoke the function directly through HTTP if required.

    Notes on Function Logic:

    This program assumes a function named process_image that you would need to define in your Python code for the Cloud Function. This function should handle the logic of processing the uploaded images using Google's AI services, and deposit the results into the processed_images_bucket. Your function code needs to be packed in a ZIP archive and uploaded to the raw_images_bucket for the Cloud Function resource to use.

    Please make sure to add the actual image processing logic within the Cloud Function's code and follow any specific Cloud Function packaging instructions from Google. You may need to include additional dependencies or configure additional API settings for the image processing to work.