https://drive.google.com/drive/u/5/folders/1Q1gQMsqVnR0a5XXql5cQoaeUjTL7pNaY
Language as a probabalistic network
Words get their meaning from probabalistic association with other words:
Language as a generative, evolving system
Words shakespeare invented—filling in the adjacent possible
Tip of the linguistics iceberg, predates LLMs
“the limits of my language mean the limits of my world” - Wittgenstein
Wittgenstein: the world is as we describe it
vs.
Plato: language strives to describe the world as it is
Background theory for the question that’s occupied me: will machines ever invent words like shakespeare did?
In probabalistic terms, this means filling in or expanding the semantic space
Progression of Technical Experiments
One dimensional space
Vectorizing animals on one dimension and seeing how LLM fills in space with existing animals
Screen Recording 2025-03-07 at 8.58.42 AM.mov
Two dimensional space: Animal UMAP
Vectorizing animals on two dimension with UMAP and seeing how LLM fills in space with exisitng animals