Why would the embeddings be higher dimensionally than the data? I imagine the em... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		catlifeonmars 4 months ago \| parent \| context \| favorite \| on: I want everything local – Building my offline AI w... Why would the embeddings be higher dimensionally than the data? I imagine the embeddings would contain relatively higher entropy (and thus lower redundancy) than many types of source data.

cm228 4 months ago [–]

depends on the chunk-size used to create the embedding.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact