Not sure about copilot, but I recently became aware of llmware:

https://llmware-ai.github.io/llmware/

https://github.com/llmware-ai/llmware

There's also Simon Wilson's llm cli:

https://llm.datasette.io/en/stable/

https://github.com/simonw/llm

Both might help getting started with some LLM experiments.