Databricks Certified Generative AI Engineer Associate · Free Practice Question Medium
Question 12
Why is it essential to evaluate an LLM's context length when integrating it into a document summarization pipeline?
- A To reduce token usage and inference cost.
- B To ensure the model can process input documents without truncation, preserving key information.
- C To ensure shorter summaries.
- D To improve model training efficiency.
Reveal correct answer
Correct answer: B
Explanation
Evaluating context length ensures the model can process the full document without losing critical details due to truncation.A. Incorrect: While context length affects cost, its primary role is handling input effectively.
B. Correct: Adequate context length ensures the entire document is processed, avoiding loss of critical details.
C. Incorrect: Context length does not directly control summary length.
D. Incorrect: Context length is unrelated to training efficiency; it impacts input handling during inference.
Discussion
Think the marked answer is wrong, or have a better explanation? Share it below — comments appear after review.
You must be logged in to post a comment.
