AWS Certified AI Practitioner · Free Practice Question Easy
Question 2
A company is using Amazon Bedrock and it wants to set an upper limit on the number of tokens returned in the model's response.
Which of the following inference parameters would you recommend for the given use case?
-
A
Top K
-
B
Top P
-
C
Response length
-
D
Stop sequence
Reveal correct answer
Correct answer: C
Explanation
Correct option:
Response length
Response length represents the minimum or maximum number of tokens to return in the generated response.
Incorrect options:
Stop sequence - Stop sequences specify the sequences of characters that stop the model from generating further tokens. If the model generates a stop sequence that you specify, it will stop generating after that sequence.
Top P - Top P represents the percentage of most likely candidates that the model considers for the next token.
Top K - Top K represents the number of most likely candidates that the model considers for the next token.
References:
https://docs.aws.amazon.com/bedrock/latest/userguide/inference-parameters.html
https://docs.aws.amazon.com/bedrock/latest/userguide/general-guidelines-for-bedrock-users.html
Discussion
Think the marked answer is wrong, or have a better explanation? Share it below — comments appear after review.
