Do we need a LLM for that?

Not necessarily. But fixed code tends to not adapt to changing situations.

“Hey, my mother-in-law is coming today. She drives a blue Ford pickup. Let her in and record the car plate for future use.”

“There are servicemen coming today around noon. They should check the electricity box and leave in a few minutes. Let me know if they do something else.”