New Model Branch Testing #699
Replies: 20 comments 129 replies
-
not sure what went wrong, this is what I get: I did the following:
|
Beta Was this translation helpful? Give feedback.
-
Nice work! This is exactly what I was going to suggest - to be able to run both models in the same installation. I will try to test this at my place here in Sweden. I believe that the new model works better here already than what is said, not only in the USA. I have three species lists - TF-Lite (6363 species), BirdNET-Analyzer (3350 species) and a list of Swedish species (494 species), which I assume mostly matches the European list, but translated into Swedish. If I match my Swedish list in Excel against TF-Lite, 50 species are missing (10%) and matching against BirdNET-Analyzer results in missing 110 species (22%). In both cases, only a very few species (6 and 17 respectively) are of importance as the others are species that are included in the European list but are not found in Sweden. I have installed BirdNET-Analyzer in Windows 11 and tested with a self-recorded sound file. If I enter my position in Sweden and week 1 (winter) I get the following message "Species list contains 130 species". If I change to week 25 (summer) I get the following: "Species list contains 146 species". This means that the program takes into account position and time of year and that there are significantly more species than what was said recognized in Europe in BirdNET-Analyzer, but the numbers are still a bit low compared to the findings I made in the Excel search. |
Beta Was this translation helpful? Give feedback.
-
@ehpersonal38 Hi, I followed you instructions ( Any clue ? |
Beta Was this translation helpful? Give feedback.
-
Strangely, I only managed to switch from the previous model to the new one by changing the Species Occurence Frequency Threshold (with the 0,03 original value, I had a prompt telling me to choose between 0,0205 and 0,0305). |
Beta Was this translation helpful? Give feedback.
-
@ehpersonal38 I am also testing two installations (old and new model) in parallel and will return later with the results. |
Beta Was this translation helpful? Give feedback.
-
@ehpersonal38 PS : Despite that, the New Model seems to work fine for me... 😄 |
Beta Was this translation helpful? Give feedback.
-
I have now tested both models during this weekend with identical hardware, with the same settings and with the microphones next to each other. The new model seems to report slightly more detections and more species. The number for each species varies up or down depending on the species, for most the numbers are quite similar. The most positive thing though is that I haven't had a single detection of a species that shouldn't be here at this time of year and that's certainly not the case in the old model. I think this indicates that the connection to eBird also works in Sweden and would think that it also applies to the rest of Europe. I've checked eBird reports for a few different countries and it seems to be about the same level, though not nearly as big as in the US. I have checked some sounds and most of them seem to be correct. Now I'm not particularly good at sounds, so I've asked some experts to listen and report back with results. I hope to return with this. The new model works, as expected, even with my adaptations and the translation into Swedish that I made and that most people seem to be using here in Sweden. I suggest that the new model can be implemented in the main branch. Link to my test system with the new model: https://birdnetpitest.svardsten.se |
Beta Was this translation helpful? Give feedback.
-
@ehpersonal38 @Svardsten53 |
Beta Was this translation helpful? Give feedback.
-
@ehpersonal38 - for the BirdWeather detection posts with the new model, could I ask that that you make one change, so that we're tracking which model is posting detections to BirdWeather : post_algorithm = ""algorithm": " + ""2p2"" + "," Thanks! |
Beta Was this translation helpful? Give feedback.
-
Hi, I'm wondering if there's a way, in order to check the new model on rarest European birds, to give the new model sounds correctly labeled by the previous model, to check if it gets them right ? I don't know if such a thing can be done, I'm just asking... 😉 Thanks ! |
Beta Was this translation helpful? Give feedback.
-
Hi, Using the New Model, I recently had 2 different subspecies tagged on the same sample. Is Birdnet-Pi able to put several label on a 3 seconds sample or is that a small software hiccup ? Thanks ! |
Beta Was this translation helpful? Give feedback.
-
@ehpersonal38 |
Beta Was this translation helpful? Give feedback.
-
|
Beta Was this translation helpful? Give feedback.
-
Gave the new model a quick wir, installation went fine but it started reporting Crows as Wren-Warblers. And blue tits as grey hooded gulls, which according to ebird have never been sighted where I live. Understandable for the snowy mountains far from the sea. I'll leave it to mature a tad. |
Beta Was this translation helpful? Give feedback.
-
Just reporting in from Sydney! The clone, running the new model, of my BirdNetPi is still chooching along just fine. In-fact, it has a curious habit of picking up a few more detections (and they are real, I checked) but I'm now starting to wonder if the new ones microphone is just a smidge better. Am going to do some testing regarding that but there have been no appreciable detection degradation through using the new model in Australia, so it appears to be working for my birds just fine. |
Beta Was this translation helpful? Give feedback.
-
I'm still confused on wether the new model is just for Americans or European users? I'll be recording my 100 000 detection some time tomorrow. A perfect timing to switch to the new model if the consensus is, that it would be an improvement for me here in Germany.
|
Beta Was this translation helpful? Give feedback.
-
Anyone in Australia running the new model and done any comparisons between the two? |
Beta Was this translation helpful? Give feedback.
-
Last night two local Tawny owls woke me up in the middle of the night. Out of curiosity I checked if it had been captured but it wasn't showing on the Overview. I checked the logs and I could see it being successfully recognised just not recorded into the database. I'm using the new model with stock settings (Occurence Frequency 0.03) and wondering if I need to change something? This is the second night in a row it has missed it. Lat/Long are set correctly and the owl has been previously recognised on the old model. Any ideas gratefully received |
Beta Was this translation helpful? Give feedback.
-
Seems the same problem as my thread #740 My apprise code seems to be an incorrect version. It does not have proper initialisation of plugin_paths for apprise I wonder whether the 2081 updates were some sort of regression to an older version / older codebase. I was thinking of updating apprise manually but wondering whether there is something more than just that which has gone wrong. |
Beta Was this translation helpful? Give feedback.
-
The location information seems to have an issue. I've put in a location in the Northeast US: And the species list tester returns a bunch of birds in South America:
|
Beta Was this translation helpful? Give feedback.
-
Please put your discussions in regards to the new branch
new_model
here!Refer to #184 (comment) for instructions on how to try it out.
Beta Was this translation helpful? Give feedback.
All reactions