Application Insights warning on llm model deprecation #2524
Conversation
…nications to signal model changes on CAPI/managed AI resources
Readability and structure improvements Co-authored-by: Natalie Karolak, MVP <[email protected]>
…thub.com/microsoft/BCApps into isv-telemetry-on-llm-deprecation-rebranch
…elemetry-on-llm-deprecation-rebranch
|
Issue #548931 is not valid. Please make sure you link an issue that exists, is open and is approved. |
christian-andersen-msft
changed the title
christian-andersen-msft
requested review from
encimita,
msft-sam and
haoranpb
| UnableToGetDeploymentNameErr: Label 'Unable to get deployment name, if this is a third party capability you must specify your own deployment name. You may need to contact your partner.'; | ||
| GPT4oLatestLbl: Label 'gpt-4o-latest', Locked = true; | ||
| GPT4oPreviewLbl: Label 'gpt-4o-preview', Locked = true; | ||
| GPT4oMiniLatestLbl: Label 'gpt-4o-mini-latest', Locked = true; | ||
| GPT4oMiniPreviewLbl: Label 'gpt-4o-mini-preview', Locked = true; | ||
| DeprecatedDeployments: Dictionary of [Text, Date]; | ||
| DeprecationDatesInitialized: Boolean; | ||
| DeprecationMessageLbl: Label 'Deployment %1 deprecated from %2. Check out codeunit 7768 AOAI Deployments', Comment = 'Telemetry message where %1 is the name of the deployment and %2 is the date of deprecation'; |
There was a problem hiding this comment.
Do we translate these strings or do we emit partner telemetry always in english?
If we translate them, you are good, but if we emit in english, you need to lock this string for translations, by adding , Locked = true after you close the quote of the comment
| exit; | ||
|
|
||
| // Add deprecated deployments with their deprecation dates here | ||
| DeprecatedDeployments.Add(Turbo0301SaasLbl, DMY2Date(1, 11, 2024)); |
There was a problem hiding this comment.
This label is defined in the file, but it's between the #if not CLEAN25 and the #endif preprocessor directive. That means it will be automatically removed in a couple of major updates. At that point, your code will no longer compile, so you need to add the lines for this model and the other obsoleted models within an #if not CLEAN25 and an #endif as well.
We can talk about this in person if you like :)
| UnableToGetDeploymentNameErr: Label 'Unable to get deployment name, if this is a third party capability you must specify your own deployment name. You may need to contact your partner.'; | ||
| GPT4oLatestLbl: Label 'gpt-4o-latest', Locked = true; | ||
| GPT4oPreviewLbl: Label 'gpt-4o-preview', Locked = true; | ||
| GPT4oMiniLatestLbl: Label 'gpt-4o-mini-latest', Locked = true; | ||
| GPT4oMiniPreviewLbl: Label 'gpt-4o-mini-preview', Locked = true; | ||
| DeprecatedDeployments: Dictionary of [Text, Date]; | ||
| DeprecationDatesInitialized: Boolean; | ||
| DeprecationMessageLbl: Label 'Deployment %1 deprecated from %2. Check out codeunit 7768 AOAI Deployments', Comment = 'Telemetry message where %1 is the name of the deployment and %2 is the date of deprecation'; |
There was a problem hiding this comment.
Let's make the text a bit more dev friendly.
We detected usage of the Azure OpenAI deployment "%1". This model is obsoleted starting %2 and the quality of your results might vary after that date. Check out codeunit 7768 AOAI Deployments to find the supported deployments.
Summary
Use of deprecated llm models in extensions will be logged in 3rd party Application Insights with a warning
Work Item(s)
Fixes AB#548931