AWS Certified AI Practitioner · Free Practice Question Medium
Question 51
A company is using Amazon Bedrock and it wants to regulate the number of most-likely candidates considered for the next word in the model's output.
Which of the following inference parameters would you recommend for the given use case?
-
A
Top P
-
B
Top K
-
C
Stop sequences
-
D
Temperature
Reveal correct answer
Correct answer: B
Explanation
Correct option:
Top K
Top K represents the number of most likely candidates that the model considers for the next token. Choose a lower value to decrease the size of the pool and limit the options to more likely outputs. Choose a higher value to increase the size of the pool and allow the model to consider less likely outputs.
via - https://docs.aws.amazon.com/bedrock/latest/userguide/inference-parameters.html
Incorrect options:
Temperature - Temperature is a value between 0 and 1, and it regulates the creativity of the model's responses. Use a lower temperature if you want more deterministic responses, and use a higher temperature if you want more creative or different responses for the same prompt on Amazon Bedrock.
Top P - Top P represents the percentage of most likely candidates that the model considers for the next token. Choose a lower value to decrease the size of the pool and limit the options to more likely outputs. Choose a higher value to increase the size of the pool and allow the model to consider less likely outputs.
Stop sequences - Stop sequences specify the sequences of characters that stop the model from generating further tokens. If the model generates a stop sequence that you specify, it will stop generating after that sequence.
References:
https://docs.aws.amazon.com/bedrock/latest/userguide/inference-parameters.html
https://docs.aws.amazon.com/bedrock/latest/userguide/general-guidelines-for-bedrock-users.html
Discussion
Think the marked answer is wrong, or have a better explanation? Share it below — comments appear after review.
