Generative AI Leader · Free Practice Question Medium

Question 6

A bank needs to build an AI agent for mortgage pre-qualification. The agent must use the bank's private knowledge base and connect to a live API for interest rates.

Which approach offers the best balance of speed, security, and capability on Google Cloud?

  • A

    Fine-tuning an open-source LLM on conversation transcripts.

  • B

    Using Vertex AI Agent Builder to ground a model in their data and connect to the API via tools.

  • C

    Training a new foundation model from scratch on the bank's data.

  • D

    Buying a generic, third-party chatbot SaaS product.

Reveal correct answer

Correct answer: B

Explanation

The challenge is to build a specialized agent that can securely access both a private, static knowledge base (internal documents) and dynamic, real-time data (interest rate API). The solution must be efficient to build and maintain.

INCORRECT: Buying a generic, third-party chatbot SaaS product.
A generic SaaS product would be difficult to integrate securely with the bank's internal data and proprietary APIs. It also poses a data governance and security risk, as sensitive customer data would be handled by an external vendor.

INCORRECT: Training a new foundation model from scratch on the bank's data.
Training a foundation model from scratch is a massive, multi-year undertaking requiring immense data and compute resources. It is completely impractical and cost-prohibitive for this specific business application.

INCORRECT: Fine-tuning an open-source LLM on conversation transcripts.
Fine-tuning can teach the model a conversational style or specialized knowledge but does not inherently give it the ability to access real-time information from an API or search a private knowledge base. This approach only solves part of the problem.

CORRECT: Using Vertex AI Agent Builder to ground a model in their data and connect to the API via tools.

Vertex AI Agent Builder is the purpose-built solution for this exact scenario. It provides a framework to ground a model in specific enterprise data (via Vertex AI Search) and to connect it to external systems and APIs using tools. This allows for rapid, secure development without starting from scratch.

Discussion

Think the marked answer is wrong, or have a better explanation? Share it below — comments appear after review.

You must be logged in to post a comment.

Preparing For

Your Certification?

255+ certifications
Detailed explanations
Free PDF samples

Has All The Questions You Need