Category Archives: Blog

Mediating meaningful birding experiences through Name That Bird

In my process of creating a smart phone application that enables birders to identify, annotate, and share birdsong recordings, I am looking to gain more insight in the area of user experience design. Admittedly, I am well aware of my ignorance of even the most basic ideas behind designing effective user experiences. I come from a more back-end design background, focusing on implementing the “engine” of application more than the overall user experience. I often think of the latter as a user interface design oriented problem, so my self-proclaimed lack of a developed visual aesthetic sense tends to be reason enough to either ignore the design duties or leave them to someone else who is more gifted in those areas. However, in reading Marc Hassenzahl’s book Experience Design: Technology for All the Right Reasons, I have come to a greater understanding of the depth of experience design that I hope will encourage me to approach the problem with more insight and confidence than before.

In his book, Hassenzahl provides an insightful discourse on the topic of user experience design. He presents user experience design as an opportunity to mediate meaningful experiences for users through the use of products that incorporate interactive technology. Interestingly, he asserts that there is a fundamental separation between the experience created by the use of the technology and the inherent meaningfulness of the experience itself. Therefore, technology cannot necessarily provide significant meaning to an experience; rather, it serves to bring out that inherent meaningfulness in new and hopefully effective ways.

In my process for creating an application that can assist birders in the field, one of my primary goals in the beginning stage of designing this technology is to discover what makes the experience of birding meaningful to people. Since I am not a birder myself, I have consulted friends of friends who are avid birders. One of the most helpful questions thus far has been asking people to describe experiences they’ve had with birds that have had a strong impact on them. Although I am still waiting to receive more responses before analyzing the answers deeper, most of the responses hinted at the significance of being able to understand and connect with nature on a deeper level. By listening to the birds and attempting to identify their species, people feel closer to nature. I believe that the crowdsourced recording, listening, and identification aspect of this project will help to facilitate the meaningfulness of that experience in an effective way. Specifically, I plan to incorporate gaming features that will provide incentives for users to listen and record more, such as an identification tracker that tells users how many bird species they have recorded and identified. Features such as this will allow users to visualize how many birdsongs they have connected with, which will hopefully encourage them to continue to connect with nature more.

Avid birders often feel compelled to listen to birds and identify their species. One of the participants simply wrote that he/she is “always listening to birds,” whether walking through the woods or walking to work. However, the learning curve that is required for a birder to become proficient at identifying a bird by its sound is steep, so a technology that could assist birders in this process would help new birders hone their skills quickly. Hassenzahl writes about the importance of creating a user experience that exposes a universal psychological need, creates the urge to fulfill that need, and satisfies that urge. Hassenzahl’s points beg the question, “What is the psychological need that birders wish to fulfill?” In my opinion, this need is the connection with nature that influences so many birders to undertake the challenge of birding. They want to feel like they have a greater familiarity with the nature that surrounds them, and knowing the species of the birds singing near them provides that familiarity. I think of this experience as being similar to the feeling you can get when walking down the street you live on – you know your neighbors, your neighbors know you,  and telling each other hello provides a sense of belonging to the neighborhood. Similarly, birders want to feel like they are a part of nature by knowing the names of the birds that surround them.

Now that I’ve identified the psychological need of a deeper connection with nature that birders wish to fulfill in their experience of birding, my goal is to create an application that incorporates a user experience that both creates the urge to fulfill that need and provides users with the means to fulfill the need. Therefore, I need to craft my application in such a way that it communicates to birders that using the app in the field will help them become closer to nature by enabling them to better identify bird species through their songs. The primary feature of this application that will communicate this is the crowdsourcing component, which puts the call to action on the everyday birder to play his part in contributing to the collective understanding of birdsong by the birding community. The app will need to be presented to birders in such a way that they understand that using the app helps both themselves and others to form a deeper connection with nature through a deeper understanding of nature. Specifically, one feature of the application will involve asking birders to verify the correctness of the species that other birders attributed to a birdsong recording. Each birder’s identification accuracy will be tracked and utilized to determine a confidence interval for that birder’s identifications. Thus, birders are incentivized to use the app more often to both hone their skills at identification and fulfill the collective urge to more fully understand birdsong.

It is my hope that birders will come to see the Name That Bird application as a useful resource for them as they seek to become better birders. In order for that to happen, I need to design the experience of the app around the most important psychological desires of the birder: forming a deeper connection with nature. By focusing on crowdsourcing and gaming features, Name That Bird will provide the user experience that will fulfill the need of the birders that use it.

Tech Trends in Music Education: Final Project Overview

Name That Bird: An Android Application for Crowdsourcing the Recording and Identification of Birdsongs

Currently, there exists no Android application that enables users to simply record birdsongs and contribute their recordings to a database. Such a resource would be beneficial to many types of users, such as bird enthusiasts, ornithologists, data scientists, and bird-influenced musicians such as myself. Birdsong apps currently in the marketplace mostly come in the form of field guide apps such as iBird [1], Audubon [2], Sibley [3]; and call playback apps such as blueBill [4]. Additionally, there are two apps, BirdSongId [5] and WeBIRD [6], that are soon entering the marketplace that can perform automatic call recognition. However, while there are some web services, such as AmiBio [7] and ARBIMON [8], that are aimed at collecting recordings in order to improve automatic biodiversity monitoring algorithms, no such smart phone app exists that allows the user to record, identify, upload, and explore birdsong recordings to a database manually. Such a resource would be a very valuable asset that could provide larger data sets for data scientists that would increase the accuracy of automatic birdsong recognition algorithms employed in apps such as [5, 6]. While sound data sets such as Million Song Dataset [9], Freesound.org [10], Macaulay Library [11], and XenoCanto.org [12] provide access to many songs, sounds, and birdsongs, they are not set up in such a way to faciliate the automatic upload of sounds using means such as an Android application. Thus, I am writing a smartphone application that will facilitate the crowdsourcing of birdsong recordings into a central database that will be freely accessible to the public.

Name That Bird is an application that will facilitate the crowdsourcing of a large database of birdsong recordings. The database will then be used as the primary data set for training and testing automatic birdsong detection and species classification algorithms.

The process for building this application will include building several versions of the app, integrating user feedback into the design process as the app progresses. First, I will create a basic Android app with recording and playback functionality. This component of the app will function similar to the Heard [13] and Shoudio [14] smart phone applications. Then, I will set up a server to store the audio files and create a MySql database for storing metadata, such as the path to the audio file and any useful metadata. Once the database is functioning, I will integrate the Android app with the database, which involves making it possible for a user to upload a sound recording and other data to the database by using the app. Next, I will perform the first round of user testing with a pre-selected group of ornithologists and bird enthusiasts. I will then incorporate their feedback into a second iteration of the app, especially their comments on the user interface and experience. Finally, I will perform another round of user testing and release the app to the general public.

This is a huge project that involves writing large amounts of code to perform many different tasks. Thus, the timeline for creating this app extends beyond the duration of the class. However, I plan to at least create an app that can allow users to record, identify, and store the recordings on their mobile devices. I will only incorporate the database and server functionality to the extent that time permits.

References

[1] iBird: http://ibird.com/

[2] Audubon: http://www.audubonguides.com/field-guides/bird-identification-app.html

[3] Sibley: http://www.sibleyguides.com/about/the-sibley-eguide-to-birds-app/

[4] blueBill: http://bluebill.tidalwave.it/mobile/

[5] BirdSongId: http://www.isoperla.co.uk/BirdSongIdiPhone.html

[6] WeBIRD: http://grow.cals.wisc.edu/environment/smart-birding

[7] AmiBio: http://www.amibio-project.eu/

[8] ARBIMON: http://arbimon.com/

[9] Million Song Dataset: http://labrosa.ee.columbia.edu/millionsong/

[10] Freesound.org: http://freesound.org/

[11] Macaulay Library: http://macaulaylibrary.org/

[12] XenoCanto.org: http://www.xeno-canto.org/

[13] Heard App: http://www.heardapp.com/

[14] Shoudio: http://shoudio.com/

Music Ed-Tech

Hey fellow classmates! I’m following Ethan’s lead here and making my blog for this class a special section of my already existing blog. All posts pertaining to this class will be tagged “m-tech-ed”.

Thanks!