How will you train this? I understand it replicating bird songs, but what data will it use for actual translation?

It would operate a lot like image recognition tasks, probably in frequency 0 domain for a concrete space to operate in. SLID or other information theoretic approaches could isolate common signals, then translate that to captured environmental information (e.g prairie dogs identifying predators).

Animals don't use a known syntax per se, so it wouldn't be authentic translation, but a transliteration may be possible. Also, there is no guarantee that one animal doing something (like a dog's behavior for going to the bathroom) maps to many or all dogs.

▲

chrisco255 3 days ago | parent | prev | next [-]

The Crowsetta Stone

▲

crowsettastone 3 days ago | parent | next [-]

Here you go.

https://claude.ai/public/artifacts/ec289f75-9daf-49bd-96ae-a...

▲

imglorp 3 days ago | parent [-]

Amazing, I gave it a recording and it gave an analysis.

Do you know how to hear the generated sounds? Pressing the buttons shows a "playing" console message but there's no audio.

	▲	crowsettastoner 3 days ago \| parent [-]
		[dead]

▲

crowsettastoner 3 days ago | parent | prev [-]

[dead]

▲

bhickey 3 days ago | parent | prev | next [-]

Probably the same way many other models are trained: autoregression or autoencoding. You'd either predict the next symbol, or you compress it into a latent space and reconstruct the original. My assumption is that birdsong is sequential, but this isn't something I know about. An entire song might be the smallest semantic unit, like the alien language in Arrival, though I think this is unlike.

	▲	cluckindan 2 days ago \| parent [-]
		Sometimes birds communicate via melody (songbirds), sometimes via repetition (ducks, geese), sometimes via timbre (pigeons, doves), and sometimes via a combination of the former and sound-making in general. Sometimes birds communicate nonverbally as well, as in gaze direction and body posture.

▲

diggan 3 days ago | parent | prev | next [-]

> but what data will it use for actual translation?

I'm no ornithologist, for forgive my ignorance, but shouldn't there be bunch of papers out there where researchers try to infer the meaning of various sounds birds produce, together with a description of the sound and even samples of it? I don't know how numerous that could be, but could maybe be used as a starting point at least.

▲

ileonichwiesz 3 days ago | parent [-]

There are large datasets of bird sounds (eBird, Cornell Labs, etc), but the descriptions are usually limited to the species, location, and something like “mating call” or “contact call”. Hugely useful for building models that can recognise birds by call (apps like that already exist, I recommend Merlin Bird ID), but definitely not enough for something approaching actual translation.

FWIW there’s no research to indicate that the sounds birds make are what we’d call language. They’re avid communicators, and some species are known to be highly intelligent, but of course it’s not like “caw” means “to fly” and “craah” is “forward”.

▲

cluckindan 2 days ago | parent [-]

I’ve been winter feeding the local birds for a couple years now, and especially the great tits acknowledge my presence via a special call I haven’t heard anywhere else. It’s distinct from the calls they use when they find food otherwise. Bird ID applications consistently fail to recognize the species based on that call.

There are stationary feeders in the neighborhood, but the birds don’t seem to associate the humans filling them with their food, and subsequently just use warning calls when they see humans approaching the feeders.

But whenever they see me, even in the summer, they use that call. Blue tits have their own, shorter variation of it.

I like to think they’ve given me a name in their language :-)

	▲	diggan 2 days ago \| parent [-]
		> I like to think they’ve given me a name in their language :-) Probably best for everyone involved to not understand the meaning of the name they gave you too! :)

▲

cluckindan 2 days ago | parent | prev | next [-]

It would need contextual information of what the bird is communicating about and to whom. 360 degree video with object/species detection and a custom bird/flock behavior classifier?

▲

macrolime 3 days ago | parent | prev [-]

YouTube videos of birds?

	▲	loveparade 3 days ago \| parent [-]
		I hope the EditorBird added subtitles.