Pull requests: openvinotoolkit/openvino.genai
Pull requests list
[LLM/VLM] Stop generation when streaming callback returns true
category: continuous batching
Continuous batching
category: LLM
LLM pipeline (stateful, static)
#1410
opened Dec 19, 2024 by
ilya-lavrenov
Loading…
StaticLLMPipeline: Cherry-pick num_key_value_heads not present in config.json
category: LLM
LLM pipeline (stateful, static)
category: NPU
#1409
opened Dec 19, 2024 by
TolyaTalamanov
Loading…
[ SD ] Fix of scheduler config for main_pipeline
category: speculative decoding
Speculative decoding
no-match-files
#1406
opened Dec 18, 2024 by
iefode
Loading…
Cross referencing blogs in genai samples readme
category: samples
GenAI samples
#1399
opened Dec 17, 2024 by
DimaPastushenkov
Loading…
Removed WAs for OpenVINO: pass properties as is
category: continuous batching
Continuous batching
category: GHA
CI based on Github actions
category: LLM
LLM pipeline (stateful, static)
category: Python API
Python API for GenAI
category: speculative decoding
Speculative decoding
category: text to image
Text 2 image pipeline
category: tokenizers
Tokenizer class or submodule update
category: visual language
Visual language pipeline
category: whisper
Whisper pipeline
no-match-files
#1396
opened Dec 17, 2024 by
ilya-lavrenov
•
Draft
Whisper pipeline: cache models in python tests
category: whisper
Whisper pipeline
#1389
opened Dec 16, 2024 by
as-suvorov
•
Queued
[ CB ][ SD ] Implement streaming with using Continuous batching
category: LLM
LLM pipeline (stateful, static)
category: samples
GenAI samples
category: sampling
Sampling / Decoding algorithms
no-match-files
stop_strings and include_stop_strings via streamer & generation handling
category: continuous batching
#1382
opened Dec 13, 2024 by
iefode
Loading…
Whisper pipeline: implement 'initial_prompt' and 'hotwords' parameters
category: GenAI C++ API
Changes in GenAI C++ public headers
category: Python API
Python API for GenAI
category: samples
GenAI samples
category: whisper
Whisper pipeline
no-match-files
#1378
opened Dec 13, 2024 by
as-suvorov
•
Queued
[WWB]: Add ImageText-to-Image pipeline validation
category: WWB
PR changes WWB
#1373
opened Dec 12, 2024 by
AlexKoff88
Loading…
[LLM Bench] Allow Image Generation Models to Run in BF16
category: llm_bench
Label for tool/llm_bench folder
#1368
opened Dec 12, 2024 by
anzr299
Loading…
[CB]Support 4-bit cache
category: continuous batching
Continuous batching
do_not_merge
no-match-files
#1366
opened Dec 12, 2024 by
zhangYiIntel
•
Draft
Dynamic KV cache allocation
category: continuous batching
Continuous batching
category: samples
GenAI samples
no-match-files
#1364
opened Dec 11, 2024 by
popovaan
Loading…
[LLM Bench] Defining Framework in Torch Compile Benchmarking
category: llm_bench
Label for tool/llm_bench folder
#1354
opened Dec 10, 2024 by
anzr299
Loading…
[WIP] LoRA for FLUX
category: GenAI C++ API
Changes in GenAI C++ public headers
category: text to image
Text 2 image pipeline
Add perf metrics support for WhisperStaticPipeline
category: NPU
category: whisper
Whisper pipeline
no-match-files
#1337
opened Dec 6, 2024 by
eshiryae
Loading…
Add slice before matmut transformation for CB scenario
category: continuous batching
Continuous batching
category: LLM
LLM pipeline (stateful, static)
category: sampling
Sampling / Decoding algorithms
category: speculative decoding
Speculative decoding
no-match-files
#1261
opened Nov 27, 2024 by
olpipi
Loading…
Update requirements.txt for 2024.6 validation
do_not_merge
#1260
opened Nov 27, 2024 by
peterchen-intel
•
Draft
[VLM] Image resize model
category: GHA
CI based on Github actions
category: tokenizers
Tokenizer class or submodule update
category: visual language
Visual language pipeline
Parallel sampling with threadpool
category: continuous batching
Continuous batching
category: sampling
Sampling / Decoding algorithms
no-match-files
#1252
opened Nov 25, 2024 by
mzegla
Loading…
ProTip!
Follow long discussions with comments:>50.