Category Archives: News

Crowdsourcing and basic data visualization in the humanities

In late July I led a week-long course about crowdsourcing and data visualization at the Digital Humanities Oxford Summer School. I taught the crowdsourcing part, while my friend and collaborator, Sarah, from Google, lead the data visualization part. We had six participants from fields as diverse as history, archeology, botany and literature, to museum and library curation. Everyone brought a small batch of images, and used the new Zooniverse Project Builder (“Panoptes”) to create their own projects. We asked participants what were their most pressing research questions? If the dataset were larger, why would crowdsourcing be an appropriate methodology, instead of doing the tasks themselves? What would interest the crowd most? What string of questions or tasks might render the best data to work with later in the week?

Within two days everyone had a project up and running.  We experienced some teething problems along the way (Panoptes is still in active development) but we got there in the end! Everyone’s project looked swish, if you ask me.

Digging the Potomac

Participants had to ‘sell’ their projects in person and on social media to attract a crowd. The rates of participation were pretty impressive for a 24-hour sprint. Several hundred classifications were contributed, which gave each project owner enough data to work with.

But of course, a good looking website and good participation rates do not equate to easy-to-use or even good data! Several of us found that overly complex marking tasks rendered very convoluted data and clearly lost people’s attention. After working at the Zooniverse for over a year I knew this by rote, but I’d never really had the experience of setting up a workflow and seeing what came out in such a tangible way.

Despite the variable data, everyone was able to do something interesting with their results. The archeologist working on pottery shards investigated whether there was a correlation between clay color and decoration. Clay is regional, but are decorative fashions regional or do they travel? He found, to his surprise, that they were widespread.

In the end, everyone agreed that they would create simpler projects next time around. Our urge to catalogue and describe everything about an object—a natural result of our training in the humanities and GLAM sectors—has to be reined in when designing a crowdsourcing project. On the other hand, our ability to tell stories, and this particular group’s willingness to get to grips with quantitative results, points to a future where humanities specialists use crowdsourcing and quantitative methods to open up their research in new and exciting ways.

-Victoria, humanities project lead

Introducing the Planet Hunters Educators Guide

Julie A. Feldt is one of the educators behind Zooniverse.org. She first came to us in Summer 2013 as an intern at the Adler Planetarium to develop and test out Skype in the Classroom lessons and ended up joining the team the following winter. Julie was the lead educator in the development of the Planet Hunters Educators Guide.  Here she shares some information on the development and contents of this resource.

Screenshot 2015-07-06 14.49.53

In collaboration with NASA JPL, we have developed the Planet Hunters Educators Guide, which is 9 lessons aimed for use in middle school classrooms. This guide was developed for each lesson to build upon each other while also providing all the information needed  to do them alone. Teacher can choose to do one lesson on its own or the entire collection. Each lesson was planned out using the 5E method and to be accomplishable in a single 45 to 60 minute class period with some Evaluate sections as take home assignments. In development we focused on the science behind Planet Hunters and utilized JPL’s Exoplanet Exploration program and tools from PlanetQuest in order to connect with our partners in this field.

Through this guide, we want to introduce teachers and their classrooms to citizen science, exoplanet discovery, and how the science behind the Planet Hunters project is conducted. Lesson 1 starts by acquainting the class with what citizen science is and looking at several  projects, mostly outside of the Zooniverse. This lesson is great for teachers who just want to talk about citizen science in general and therefore it encompassesmany different types of citizen science projects. The rest of the lessons go into the understanding of exoplanets and using Planet Hunters in a classroom setting.

We wanted to give teachers the lessons they may need to build student understanding of the research and science done in Planet Hunters. Therefore, Lessons 2 through 5 focus on developing knowledge of possible life outside our solar system, the methods used to discover new worlds, and what makes those worlds habitable. For instance, in Lesson 2 students explore our own solar system with consideration of where life as we know it, directing them to the idea that there may be a habitable zone in our solar system. The students are asked to break up into groups to discuss how each of the planets compare with consideration of their location . We provided solar system information cards, see an example below, for students to be able to determine the conditions necessary for life as we know it to develop and survive.

Screenshot 2015-07-06 14.49.31Screenshot 2015-07-06 14.57.12

Lesson 6 is purely about getting students acquainted with Planet Hunters, specifically how to use it and navigate the website for information. This lesson can be great for the teachers that just want to show their students how they can be a part of real scientific research. After, students use the project data to find their own results and visuals on exoplanets found in Planet Hunters. Something to note, lesson 7 and 8 are pretty similar, but Lesson 8 incorporates a higher level of math for the more adventurous or older classrooms. Lesson 9 either wraps up the guide nicely or can be a fun activity to add to your science class where the students creativity and imagination comes out through designing what they believe a real exoplanet looks like, see summary from first page below.

Screenshot 2015-07-06 14.51.16

We hope our teachers enjoy using this product! We would love you hear how you have used it and any feedback that could be used in any future development of teacher guides for other projects.

A whole new Zooniverse

Anyone heading over to the Zooniverse today will spot a few changes (there may also be some associated down-time, but in this event we will get the site up again as soon as possible). There’s a new layout for the homepage, a few new projects have appeared and there’s a new area and a new structure to Talk to enable you to discuss the Zooniverse and citizen science in general, something we hope will bring together conversations that until now have been stuck within individual projects.

Our new platform, Panoptes, is name after Argus Panoptes, a many-eyed giant form Greek mythology.
Our new platform, Panoptes, is named after Argus Panoptes, a many-eyed giant form Greek mythology. Image credit: http://monsterspedia.wikia.com/wiki/File:Argus-Panoptes.jpg

What you won’t see immediately is that the site is running on a new version of the Zooniverse software, codenamed ‘Panoptes‘. Panoptes has been designed so that it’s easier for us to update and maintain, and to allow more powerful tools for project builders. It’s also open source from the start, and if you find bugs or have suggestions about the new site you can note them on Github (or, if you’re so inclined, contribute to the codebase yourself). We certainly know we have a lot more to do; today is a milestone, but not the end of our development. We’re looking forward to continuing to work on the platform as we see how people are using it.

Panoptes allows the Zooniverse to be open in another way too. At its heart is a project building tool. Anyone can log in and start to build their own Zooniverse-style project; it takes only a moment to get started and I reckon not much more than half an hour to get to something really good. These projects can be made public and shared with friends, colleagues and communities – or by pressing a button can be submitted to the Zooniverse team for a review (to make sure our core guarantee of never wasting people’s time is preserved), beta test (to make sure it’s usable!), and then launch.

We’ve done this because we know that finding time and funding for web development is the bottleneck that prevents good projects being built. For the kind of simple interactions supported by the project builder, we’ve built enough examples that we know what a good and engaging project looks like. We’ll still build new and novel custom projects helping the Zooniverse to grow, but today’s launch should mean a much greater number of engaging and exciting projects that will lead to more research, achieved more quickly.

We hope you enjoy the new Zooniverse, and comments and feedback are very welcome. I’m looking forward to seeing what people do with our new toy.

Chris

PS You can read more about building a project here, about policies for which projects are promoted to the Zooniverse community here and get stuck into the new projects at www.zooniverse.org/#/projects.

PPS We’d be remiss if we didn’t thank our funders, principally our Google Global Impact award and the Alfred P. Sloan Foundation, and I want to thank the heroic team of developers who have got us to this point. I shall be buying them all beer. Or gin. Or champagne. Or all three.

Disaster Response in Nepal and The Zooniverse

Very soon after the recent magnitude-7.8 earthquake in Nepal, we were contacted by multiple groups involved in directly responding with aid and rescue teams, asking if we could assist in the efforts getting underway to crowdsource the mapping of the region. One of those groups was Rescue Global, an independent reconnaissance charity that works across multiple areas of disaster risk reduction and response. Rescue Global also works with our collaborators in machine learning here at Oxford, combining human and computer inputs for disaster response in a project called Orchid. And they asked us to help them pinpoint the areas with the most urgent unfulfilled need for aid.

And so we sprang into action. The satellite company Planet Labs generously shared all its available data on Nepal with us. The resolution of Planet Labs’ imagery – about 5 metres per pixel – is perfect for rapid examination of large ground areas while showing enough detail to easily spot the signs of cities, farms and other settlements. After discussions with Rescue Global we decided to focus on the area surrounding Kathmandu, with a bias westward toward the quake epicentre, as much of this area is heavily populated but we knew many other, complementary efforts were focusing on the capital itself. We sliced about 13,000 km2 of land imagery into classifiable tiles, and created a new project using brand new Zooniverse software (coming very very soon!) that allows rapid project creation.

Screen Shot of the humanitarian project run by The Zooniverse for Orchid and Rescue Global
Once we had prepared the satellite images, we created the project in less than a day. Users were asked to indicate the strength of evidence of settlements in the area, and then how much of the image was classifiable.

We also realised that if we combined our work with the results of some of the aforementioned complementary efforts, we needn’t wait for the clouds to part so that we could get post-quake images. For example, the Humanitarian OpenStreetMap Team (HOT) is doing brilliant work providing exquisitely detailed maps for use in the relief efforts. But here’s the thing: Nepal is pretty big (larger than England). And accurate, detailed maps take time. So in the days immediately following the earthquake, our area of focus – which we already knew had been severely affected – hadn’t been fully covered by HOT yet. And by comparing rapid, broad classifications of a relatively large area of focus with the detailed maps of smaller areas provided by HOT efforts, we could still make very confident predictions about where aid would most be needed even with just pre-quake images.

Because our images were in the sweet spot of area coverage and resolution, we were able to classify the entire image set in just a couple of days with the combined effort of only about 25 people, comprising students and staff members from Oxford and Rescue Global staff. For each image, we asked each person about any visible settlements and about how “classifiable” the image was (sometimes there are clouds or artefacts).

After the classifications were collected, the machine learning team applied a Bayesian classifier combination code that we first used in the Zooniverse on the Galaxy Zoo: Supernova project. After comparing these results with the latest maps from the HOT team, we saw two towns that were outside the areas currently covered by other crisis mapping, but that our classifiers had marked as high priority.

map and satellite of 2 towns, 1 of which our classifications found quickly despite it not being mapped in detail.
Maps from OpenStreetMap (left) and satellite images from Planet Labs (right) for 2 regions in Nepal. The top area shows the Kathmandu Airport (already well mapped by other efforts) and the bottom shows a town southwest of Kathmandu that, at the time of Rescue Global’s request to us, had not yet been mapped.

We passed this on to Rescue Global, who have added it to the other information they have about where aid is urgently needed in Nepal. The relief efforts are now in a phase of recovery, cleanup, and ensuring the survivors have the basic necessities they need to carry on, like clean water and food. Now they are coping with the damage from the second earthquake too.

Those on the ground are still busy providing day-to-day aid, so it’s early days yet to properly characterise what impact we may have had, but the initial feedback has been very good. We will be analysing this project in the days and weeks to come to understand how we can respond even more rapidly and accurately next time. That likely includes much larger-scale projects where we will be calling on our volunteers to help with classification efforts. We believe the Zooniverse, Planet Labs, and partners like Rescue Global and Orchid (and QCRI, our partner on other in-the-works humanitarian projects) can make a unique and complementary contribution to the humanitarian and crisis relief sphere. We will keep you posted on the results of our Nepal efforts and those of other, future crises.

PS: This activity was carried out under a programme of, and funded by, the European Space Agency; we would also like to acknowledge our funders for the current Zooniverse platform as a whole, principally our Google Global Impact award and the Alfred P. Sloan Foundation. And, to our team of developers who worked so hard to make this happen: you rock.

Header image adapted from OpenStreetMap, © OpenStreetMap contributors.

Who Are The Zooniverse Community? We Asked Them…

We are often asked who our community are by project scientists, sociologists, and by the community itself. A recent Oxford study tried to find out, and working with them we conducted a survey of volunteers. The results were interesting and when combined with various statistics that we have at Zooniverse (web logs, analytics, etc) we can start to see a pretty good picture of who volunteers at the Zooniverse.

Much of what follows comes from a survey was conducted last Summer as part of Masters student Victoria Homsy’s thesis, though the results are broadly consistent with other surveys we have performed.  We asked a small subset of the Zooniverse community to answer an online questionnaire. We contacted about 3000 people regarding the survey and around 300 responded. They were not a random sample of users, rather they were people who had logged-in to the Zooniverse at least once in the three months before we emailed them.

The remaining aspects of this post involve data gathered by our own system (classification counts, log-in rates, etc) and data from our use of Google Analytics.

So with that preamble done: let’s see who you are…

https://vimeo.com/99664654

This visualisation is of Talk data from last Summer. It doesn’t cover every project (e.g. Planet Hunters is missing) but it gives you a good flavour for how our community is structured. Each node (circle) is one volunteer, sized proportionally according to how many posts they have made overall. You can see one power-mod who has commented more than 16,000 times on Talk near the centre. Volunteers are connected to others by talking in the same threads (a proxy for having conversations). They have been automatically coloured by network analysis, to reflect sub-networks within the Zooniverse as a whole. The result is that we see the different projects’ Talk sites.

talk-central

There are users that rise largely out of those sub-communities and talk across many sites, but mostly people stick to one group. You can also see how relatively few power users help glue the whole together, and how there are individuals talking to large numbers of others, who in turn may not participate much otherwise – these are likely examples of experienced users answering questions from others.

gender One thing we can’t tell from our own metrics is a person’s gender, but we did ask in the survey. The Zooniverse community seems to be in a 60/40 split, which in some ways is not as bad as I would have thought. However, we can do better, and this provides a metric to measure ourselves against in the future.

ages

It is also interesting to note that there is very little skew in the ages of our volunteers. There is a slight tilt away from older people, but overall the community appears to be made up of people of all ages. This reflects the experience of chatting to people on Talk.

geo-pie

We know that the Zooniverse is English-language dominated, and specifically UK/US dominated. This is always where we have found the best press coverage, and where we have the most links ourselves. The breakdown between US/UK/the rest is basically a three-way split. This split is seen not just in this survey but also generally in our analytics overall.

geo-pie-dev

Only 2% of the users responding to our survey only came from the developing world. As you can see in a recent blog post, we do get visitors from all over the world. It may be that the survey has the effect of filtering out these people (it was conducted via an online form), or maybe that there is language barrier.

employmentemployment_cloudWe also asked people about their employment status. We find a about half of our community is employed (either full- or part-time). Looking at the age distribution, we might expect up a fifth or sixth of people to be retired (15% is fairly close). This leaves us with about 10% unemployed, nearly twice the UK or US unemployment rate, and about 4% unable to work due to disability (about the UK averaged, by comparison). This is interesting, especially in relation to the next question, on motivation for participating.

We also asked them to tell us what they do and the result is the above word cloud (thanks, Wordle!) which shows a wonderful array of occupations including professor, admin, guard, and dogsbody. You should note a high instance of technical jobs on this list, possibly indicating that people need to have, or be near, a computer to work on Zooniverse projects in their daily life.

motivation

When asked why they take part in Zooniverse projects we find that the most-common response (91%) is a desire to contribute to progress. How very noble. Closely following that (84%) are the many people who are interested in the subject matter. It falls of rapidly then to ‘entertainment’, ‘distraction’ and ‘other’. We are forever telling people that the community is motivated mainly by science and contribution, and for whatever reason they usually don’t believe us. It’s nice to see this result reproducing an important part of the Raddick et. al. 2009 study, which first demonstrated it.

when-to-classfy-routine

It is roughly what I would have expected to see that people tend to classify mostly in their spare time, and that most don’t have dedicated ‘Zooniverse’ time every day. It’s more interesting to see why, if they tend to stop and start, i.e. if they answered in the purple category above. Here is a word cloud showing the reason people stop participating in Zooniverse. TL;DR they have the rest of their life to get on with.

when-to-classfy-routine-cloud

We’ll obviously have to fix this by making Zooniverse their whole life!

This is my final blog post as a part of the Zooniverse team. It has been by pleasure to work at the Zooniverse for the last five years. Much of that time has been spent trying to motivate and engage the amazing community of volunteers who come to click, chat, and work on all our projects. You’re an incredible bunch, motivated by science and a desire to be part of something important and worthwhile online. I think you’re awesome. In the last five years I have seen the Zooniverse grow into a community of more than one million online volunteers, willing to tackle big questions, and trying and understand the world around us.

Thank you for your enthusiasm and your time. I’ll see you online…

Happy Halloween! Going Batty for Citizen Science

Sadly there don’t seem to be any scientifically valid citizen science projects about ghosts, poltergeists, hobgoblins, or werewolves.   There are, however plenty about that Halloween staple – the bat.

Bats get a bum wrap as blood sucking pests.  Nothing could further from the truth!   Bats are incredibly helpful to us humans because they are natural pollinators and pest controllers, but they are also an indicator species.  Indicator species are plants and animals that can be studied to give a snapshot of an ecosystem’s environmental health.

Here are a few ways that you as a citizen scientist can get involved with learning more about these amazing animals.

Bat Detective  – Zooniverse’s own bat project.  Bat calls are recorded by data collection citizen scientists and then uploaded on to the Bat Detective website.  Zooniverse volunteers classify the calls to give scientists a better idea about the distribution of these animals in Europe.

Alaska Bat Monitoring Program – Did you know that Alaska is home to five species of bats?   If you live in Alaska you can help the Alaska Department of Fish and Game collect learn more by making and sending in your observations of bats!

iBats (Indicator Bats Program) – This international effort recruits volunteers to record bat calls all around the world.  iBats is collaboration between the Zoological Society of London and the Bat Conservation Trust.

 

Know of other bat-related citizen science projects?  Please share them as a comment below!

 

Introducing Darren McRoy – Zooniverse Community Builder!

darren

 

Back in August I wrote about our search for someone we were calling a ‘community builder,’ which I said was ‘the most important job in the Zooniverse.’ The position was created because of the rapid expansion of the project, and the plans we have for the next year or two, which will mean we may be able to create hundreds or thousands of new projects. If the Zooniverse isn’t constrained by the slow process of project-by-project development, then we need to rethink how we choose what is hosted on our platform, what gets promoted—and how we talk about such things. We need, in fact, to try and build a broader Zooniverse community, capable of taking the choice of projects out of our hands. At the same time, we want the tools we use to engage with this community to let everyone have a say, from new classifiers on a single project to those who roam freely across all of our Talk discussion boards.

As many of you will have already discovered, we’ve found someone we can help us with this process — Darren McRoy. Darren is a 2010 graduate of Northwestern University’s Medill School of Journalism. He has worked as a reporter and editor and is an experienced writer and communicator with a strong focus on developing online communities and strategic digital content. One of his first projects will be gathering and compiling the feedback that will inform the upcoming rebuild of the Talk discussion system. He will be a regular presence on the forums, responding to users’ comments and concerns and seeking opportunities to spur additional conversation. He will also be contributing some written content for Zooniverse projects, blogs, websites, etc. when needed, and giving feedback to the development team.

You should see quite a lot of Darren, and we’d like to encourage you to talk to him if you have any questions, comments, concerns, or other feedback about the Zooniverse community. In particular, right now he is seeking feedback about how Talk can be improved to better serve both the science goals and the growing community of contributors and volunteers.

Darren can be reached via email at darren@zooniverse.org or DZM on Talk. Please feel free to contact him — he is looking forward to working with all of you!

Chris

We Need Us: Online Art, Powered by the Zooniverse

Screenshot 2014-10-09 12.08.31

The Zooniverse is the subject of a new artwork co-commissioned by the Open Data Institute (ODI) and The Space (a website for artists and audiences around the world to create and explore digital art). We Need Us is a ‘living’ dynamic artwork, powered by your activity on the Zooniverse, driven by the thriving mass of participation across various Zooniverse sites. You can learn more about it at www.thespace.org/weneedus

We Need Us has been created by artist Julie Freeman. She takes anonymised information from your clicks, counting the number of volunteers active on various Zooniverse projects, and classifications that you all create, every minute. She stores this in a new database as sets of values, while also recording the frequency of activity over an hour, a day, and a month. These sets of values create rhythms that are translated into moving shapes, and play different sounds.

The result is a set of living artworks – one for each of 10 Zooniverse projects – and more are on the way! The live data ensures constant change to the visual and sonic composition. The sounds are processed and manipulated just like the data.

Screenshot 2014-10-09 12.08.15

While many researchers have tried to analyse and understand the Zooniverse, We Need Us will be the first time someone has tackled the idea from the perspective of art. The Zooniverse community is an engine of discovery and a force unlike any other. We Need Us highlights its rhythms and patterns, showing how diverse and vibrant Zooniverse citizen scientists really are.

You can run the artwork in your web browser by visiting http://www.weneedus.org

Do you have what it takes to be a Zoomanities Developer?

The Zooniverse team is looking to recruit a Javascript/front-end developer as part of a joint project between Zooniverse, based in the Department of Physics at the University of Oxford, and Tate Britain (London).

Building on the success of high-profile research crowdsourcing projects such as Galaxy Zoo (www.galaxyzoo.org), Planet Hunters (www.planethunters.org), Operation War Diary (www.operationwardiary.org/) and the rest of the Zooniverse.org platform, the successful candidate will lead the development of a ‘citizen art history’ project, working closely with a team from Tate and Zooniverse.  As the lead front-end developer for the project you would have a background in excellent interface design and an understanding of user behaviour.

This is an exciting opportunity for a talented developer to work on a high-visibility project. This is a full-time position for 12 months (including benefits). Strong HTML/CSS/JavaScript skills are required including experience of working with third party REST APIs and modern JavaScript MVC frameworks like Backbone. A good understanding of user interface design is also a must. A background in developing highly-usable interfaces for web applications and experience of working with a modern web framework such as Ruby on Rails would be an advantage.

The application and further details can be found here.

The most important job in the Zooniverse

Job ad

The Zooniverse team has, over the last five years or so, shown signs of growing uncontrollably like some sort of bacterial colony that requires feeding with grant money. The job we’ve just advertised (at Adler Planetarium) might, though, be the most important yet. As those who are eager followers of this blog will know, we’re currently working hard on rebuilding the Zooniverse platform so that it can support many more projects.

If the Zooniverse can get to the point where we’re no longer constrained by the number of projects that can be built, we will need to think about how projects get chosen to appear on the Zooniverse, and about who should make that decision. Our opinion is that you – our community – should be more involved, and to work out how to make that happen we’re looking for what we’re calling a ‘community builder’. As you’ll see from the job description, this isn’t a technical post, but rather we’re looking for someone who knows how to build a community that is capable of awesome things. If that sounds like you, please get in touch.

Chris

PS The post is funded by a new grant from our friends at the Alfred P. Sloan foundation, to whom we’re eternally* grateful.

* – or as near as we can make it