Skip to content

Changing model for public one - #4060

Merged
przepeck merged 15 commits into
mainfrom
przepeck/unicode_python_fix
Mar 23, 2026
Merged

Changing model for public one#4060
przepeck merged 15 commits into
mainfrom
przepeck/unicode_python_fix

Conversation

@przepeck

Copy link
Copy Markdown
Collaborator

🛠 Summary

CVS-181828
Adding corrected generation config to demo to stop model generation after correct answer.

🧪 Checklist

  • Unit tests added.
  • The documentation updated.
  • Change follows security best practices.
    ``

Copilot AI review requested due to automatic review settings March 16, 2026 10:58

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR adds a generation_config.json file for the VLM NPU demo to ensure the model stops generating after producing the correct answer (by setting proper EOS/pad token IDs). It also updates the demo README with instructions to download this config, and separately unpins dependency versions in the agentic AI demo requirements.

Changes:

  • Added demos/vlm_npu/generation_config.json with EOS/BOS/pad token IDs for Phi-3.5-vision-instruct
  • Updated demos/vlm_npu/README.md with a curl command to download the generation config
  • Removed version pins from openai-agents and openai in demos/continuous_batching/agentic_ai/requirements.txt

Reviewed changes

Copilot reviewed 3 out of 3 changed files in this pull request and generated 2 comments.

File Description
demos/vlm_npu/generation_config.json New generation config specifying BOS, EOS, and pad token IDs
demos/vlm_npu/README.md Added curl command to download the generation config after model export
demos/continuous_batching/agentic_ai/requirements.txt Removed version pins for openai-agents and openai

You can also share your feedback on Copilot code review. Take the survey.

Comment thread demos/vlm_npu/README.md Outdated
Comment thread demos/continuous_batching/agentic_ai/requirements.txt Outdated
@przepeck

Copy link
Copy Markdown
Collaborator Author

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
@przepeck
przepeck requested review from dtrawins and rasapala March 16, 2026 12:10
@przepeck
przepeck force-pushed the przepeck/unicode_python_fix branch from 8e02aac to a7dfc85 Compare March 16, 2026 12:27
@przepeck przepeck changed the title Adding corrected generation config for demo Changing model for public one Mar 17, 2026
@przepeck
przepeck merged commit c0c7138 into main Mar 23, 2026
1 check passed
@przepeck
przepeck deleted the przepeck/unicode_python_fix branch March 23, 2026 09:34
porlows1 pushed a commit that referenced this pull request May 28, 2026
### 🛠 Summary

[CVS-181828](https://jira.devtools.intel.com/browse/CVS-181828)
Adding corrected generation config to demo to stop model generation
after correct answer.
### 🧪 Checklist

- [ ] Unit tests added.
- [ ] The documentation updated.
- [ ] Change follows security best practices.
``

---------

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants