This paper may be interesting to you. It touches on several of the topics you me...

		lqr 9 months ago \| parent \| context \| favorite \| on: Tracing the thoughts of a large language model This paper may be interesting to you. It touches on several of the topics you mentioned: https://www.science.org/doi/10.1126/scirobotics.abm6597