Skip to content

[onnx] Align requrements for fp8 example#4116

Merged
andrey-churkin merged 2 commits into
openvinotoolkit:developfrom
AlexanderDokuchaev:ad/tr5
Jun 29, 2026
Merged

[onnx] Align requrements for fp8 example#4116
andrey-churkin merged 2 commits into
openvinotoolkit:developfrom
AlexanderDokuchaev:ad/tr5

Conversation

@AlexanderDokuchaev

@AlexanderDokuchaev AlexanderDokuchaev commented Jun 29, 2026

Copy link
Copy Markdown
Collaborator

Changes

openvino==2026.2.1
transformers==5.0.0

Reason for changes

#4114

Related tickets

Tests

Test examples - success

@AlexanderDokuchaev AlexanderDokuchaev requested a review from a team as a code owner June 29, 2026 06:20
Copilot AI review requested due to automatic review settings June 29, 2026 06:20

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Updates the SmolLM2 ONNX FP8 compression example to match newer dependency versions and adapts the example code to the updated Transformers chat templating output format.

Changes:

  • Bumps openvino from 2026.2.0 to 2026.2.1 for the example environment.
  • Bumps transformers from 4.53.0 to 5.0.0.
  • Updates main.py to handle tokenizer.apply_chat_template(..., return_tensors="pt") as a batch-like structure by extracting input_ids explicitly.

Reviewed changes

Copilot reviewed 2 out of 2 changed files in this pull request and generated no comments.

File Description
examples/llm_compression/onnx/smollm2_360m_fp8/requirements.txt Aligns example dependency pins with newer OpenVINO and Transformers versions.
examples/llm_compression/onnx/smollm2_360m_fp8/main.py Adjusts chat-template tokenization handling to work with Transformers 5 return structure.

@andrey-churkin andrey-churkin merged commit 3af654c into openvinotoolkit:develop Jun 29, 2026
12 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants