Vector separator in txt knowledge source?
# 🤝help
f
Hi, I would like to be able to control where vectors start/stop inside the knowledge base. Is there a way to split knowledge source at specific points using separator? For example: TS: Timestamp 1 Text: Content 1 ---- SEPARATOR ---- TS: Timestamp 2 Text: Content 2 I would like this to become two separate vector with no overlap.
a
@witty-football-93730 do you know?
w
There is currently no way of doing this but it's an interresting idea. In the meantime you can split your content in multiple KB source, can't you ?
f
Thanks, good to know. Isn't there a 100 documents limit to KB sources?
w
Documents and plain text aren't the same plain text isn't using the documents API (yet)
2 Views