Investigating Visual Media Access to information

Getting Creative with Geolocation

Take a dive into the world of geolocation, visual analysis, and the importance of creativity in image based investigations. This brief article presents the basics as well as introduces some innovative solutions from practical cases.

This article provides a snapshot from Robin Taylor's session “More Than Meets the Eye: Geolocation for human rights investigations” at the Investigation is Collaboration conference organised by Exposing the Invisible Project on 2-6 August 2021.

by Di Luong


Geolocation means finding the real world location of an object, such as the place where a photograph was taken. This process is rarely straightforward but there are various methods - some more creative than others - of doing so. You don’t always get enough clues from an image’s metadata (data about data, or exif data) and most images won’t typically show a famous landmark in the background to help you locate the area, town or even country.

More often than not images are fuzzy and unclear or lack sufficient elements to help you geolocate them with little effort. Over the years, investigator Robin Taylor from the Tibet Research Project team has honed the skills to deconstruct an image as if it were a puzzle waiting to be solved. Robin recommends a combination of curious, never-give-up like mindset, creativity and all the Open Source Intelligence (OSINT) tools one can get their hands on in order to approximate the geolocation of an image. Robin also shares his favorite methodology for “reducing an area of interest”:

Image from presentation by Robin Taylor


Context

Identifying the time, date, location of an image are part of understanding the context of an image. Other important questions to ask are:

  • Who posted the image? Can we trace the original source?
  • Where was it posted initially ?

As an example, while searching for a missing person, an image of a banana leaf led investigators to research where banana production exists in the world. Any piece of information, no matter how minor it may appear, could give an image more context.

Screenshot from Bellingcat article “John Doe 29: Image From FBI Child Exploitation Case Geolocated to Turkey


Image analysis

Analyze an image for its landscape or terrain like a road, frozen river, or steep hill. Look for unique features like vegetation, specific trees, windows, architectural details like light-posts, balconies or rooftops. In one particular case, airplane contrails (‘condensation trails’ - the white tracks planes leave in the sky) in the sky became the basis for mapping flight patterns and geolocating an image.

Platforms like Yandex, Baidu, Google, TinEye or tools like InVid and others can also be used for reverse image searches to trace if and where an image has been uploaded and used before.


Map markings: Sun, Sand, Trees...

Orienting an image on a map provides valuable insights. Local mapping platforms or data sets with a specific themes could provide information that traditional mapping platforms cannot provide. Robin shared a few unique sources like Weather Underground to check historical weather data to corroborate image dates with weather at various locations, WolframAlpha to establish a time frame based on rainfall or London Street Trees to locate a particular type of tree across the city. SunCalc is another useful resource to identify a particular location using the sun’s direction and shadow in an image.

Crowdsourcing from online communities could garner participation from individuals with highly specialized knowledge. During a Bellingcat investigation to geolocate an image of mass executions in or near Benghazi, a Twitter user noticed the color of the sand was grey compared to other areas of Benghazi, where colors of the sand are more orange or yellow. This tip helped investigators identify the location to be in the southwest area of Benghazi. Furthermore, this was the first instance when (in August 2017) the International Criminal Court (ICC) issued its first ever arrest warrant solely based on evidence gathered via social media.


Trial and error

Sometimes you need to revisit previous assumptions. Look at the image below:

  Image from presentation by Robin Taylor

  • there is clearly a beer brand visible and that could give you some hints. But maybe not quite. Perhaps the beer is sold in other countries?
  • could the horizon line tell you something? Is there an island or other geographic elements somewhere out of view and you just need to look ‘side-ways’?

When you experience tunnel vision or feel like giving up, go back repeatedly and revisit your assumptions, check if any possible suspicion or guess may be correct or not. Try to look for what is not in an image. Even when an image shows no clear horizon, the lack of a horizon could become just as useful to reduce your area of interest.


Creativity

Leonardo da Vinci’s map of Imola, Italy (1502), source: https://commons.wikimedia.org/wiki/File:Leonardo_da_Vinci_Map_of_Imola.jpg 

Leonardo da Vinci’s map of Imola was perhaps the first ichnographic map, and it looks like a satellite map before the invention of satellites. Leonardo created this image with a tool similar to a compass and other equipment from that era. Similarly, Open Source Intelligence (OSNIT)-based investigations done by citizen investigators, journalists and others from the civil society are often not well resourced, sometimes not even funded at all. However, working with limited resources could potentially lead to ingenuity and spark creative solutions.

 


*Robin Taylor is a leading investigator on the Tibet Research Project. He is currently completing a research master’s in criminology with a focus on visual evidence and citizen investigations at Erasmus University Rotterdam & University of Kent.



This article is part of a series of resources and publications produced by Exposing the Invisible during a one-year project (September 2020 - August 2021) supported by the European Commission (DG CONNECT)

European Commission

This text reflects the author’s view and the Commission is not responsible for any use that may be made of the information it contains.


More about this topic

map of Brazil with red light dots
Mapping Satellite Imagery Research

Geojournalism Toolkit

The Geojournalism Toolkit was born when a group of environmental journalists felt a new approach was...
black and white abstract painting
Access to information
Metadata Research Data

Digital Resources for Citizen Investigators: Our recommendations

Many of us currently live and work in a challenging physical isolation imposed on us by the COVID-19...
photo of the Exposing the Invisible - The Kit's cover
Access to information Safety
Verification Data Mapping Metadata Research

Exposing the Invisible - The Kit

The Kit is a collaborative, self-learning resource that makes investigative techniques and tools use...
drawing of the document of the territorial cadastre and buildings
Mapping

Maps for Advocacy: A set of Tactical Tech tools

Created by Tactical Tech in 2008 and updated in 2010, the booklet demystifies the step-by-step proce...
GPS metadata
Investigating Visual Media
Research Verification Metadata

Digging into digital images: Extracting batch location data automatically

A how-to guide covering the basic steps for using open-source metadata extraction software on your d...
photo of the savannah from a bird's eye view
Investigating Visual Media
Mapping Satellite Imagery

Starting Satellite Investigations

In 2006, a group of Bahraini activists used Google Earth to view palaces and land owned by the elite...
Conflict and Power

From My Point of View

The second episode in the series, 'From My Point of View', rather thanlooking at professional invest...
Access to information Conflict and Power Investigating Visual Media

Hagit: DIY mapping and reclaiming the territory above our heads

Hagit talks about her mapping work with local communities, and about how aerial photography with col...
Conflict and Power Access to information Investigating Visual Media

Hagit: Photography, mapping and power

Hagit tells us how she accessed the evidence she needed (about East Jerusalem house demolitions) in ...
Investigating Visual Media Conflict and Power

Hagit: Seeing Jerusalem with new eyes

Activist and artist Hagit tells us the story of how her activism developed from childhood growing up...
part of hand drawn map with pink photo filter
Investigating Visual Media

An Atlas of Radical Cartography

A book containing ten essays and ten maps displaying social issues ranging from globalisation to gar...
 black and white plane with open door and staircase on runway

James Bridle: Seamless Transitions

A project by artist James Bridle looking to recreate the ‘invisible’ spaces around the detention cen...
Palestinian city from a bird's eye view
Money and Politics

B'Tselem Camera Project: Palestine-Israel

Featuring a project that distributes video cameras, and provides training to Palestinians living in ...
a part of a cover of the book (black and white photo of people standing backwards)
Money and Politics

The Civil Contract of Photography: A book on the power politics of the image

Author Ariella Azoulay argues that the act of photography describes the set of power relations betwe...
Conflict and Power Access to information
Mapping

Libra: The landsat imagery browser

A tool to browse, sort, and download more than 275 Terabytes of open Landsat imagery for free.
Investigating Visual Media
Mapping

Mapbox

Create your own user generated maps
Mapping Satellite Imagery

Mapknitter, a tool for "stitching" aerial images together

Mapknitter is a free, open source tool for combining and positioningimages into a composite image ma...
Investigating Visual Media
Image Research Verification Metadata

CameraV

A mobile app by The GuardianProject and WITNESS that captures and preserves the metadata of images a...
Mapping

Public Lab: DIY mapping tools

A community, which develops and applies open-source tools for environmental investigation.
Mapping Satellite Imagery

Quantum GIS

A free and open source tool to create, edit, visualise, analyse and publish geospatial data.