Added semantic chunking capabilities to our chunker model.
Expect more contextually significant passages in your results highlighting.Renamed
chunker_medical_journals_qa
to clinia-chunk
. You now need to use clinia-chunk
model ID in ingestion pipelines when using SEGMENTER
processors.Initial ReleaseAbility to use the chunker model to extract segments from long form documents using the
chunker_medical_journals_qa
model ID in ingestion pipelines when using SEGMENTER
processors.