Auto-diary turns every action into part of your story


EVER given up keeping a diary because you never remembered to fill it in? Don't worry, your cellphone could soon be helping you write one.


A team at McGill University in Montreal, Canada, is tapping into the wealth of information that your smartphone sensors collect to automatically describe your daily activity in the form of a timeline.


While GPS can easily give you information about your whereabouts outside, an accurate account of your day needs to know your movements indoors, too. To do this, the team produced software that converted the Wi-Fi signal an Android phone receives from a router into accurate indoor location information.


Next, Jordan Frank, now with Facebook in Palo Alto, California, used language-translation methods to turn this location data into a narrative text (Pervasive and Mobile Computing, doi.org/njp). "Instead of translating from, say, French to English, we translate from location signals to English," says Frank's colleague Doina Precup. They asked cellphone users to write basic English descriptions of their daily activities for two weeks to create a data set that was used to teach a machine-learning system how to convert location data into simple English sentences.


The result is not exactly great literature. A typical example reads: "I left home at 07:20. I arrived at auditorium at 11:48. I left auditorium at 11:50. I arrived at lounge at 11:52. I left lounge at 12:38. I arrived at my office at 12:46." While it might seem a bit dull at the moment, the idea is that it would serve as a template so that users could then add the colour and salient details later.


The team also aims to flesh out the diary by adding information from the apps people use, and who they call and text. "It would give more information on how you spent your time – like when and how much you were on Facebook," says Precup. The team is preparing to launch a start-up company to spin the idea into a consumer product.


Such location-based lifeloggingMovie Camera apps "are starting to appear in droves", says Gordon Bell, a Microsoft researcher in the vanguard of the lifelogging movement. He says the app could produce potentially useful diary stories – but only if users contribute. "Making something narrative doesn't necessarily make it a story," he says.


This article appeared in print under the headline "Auto-diary turns every action into part of your story"


Issue 2932 of New Scientist magazine


  • New Scientist

  • Not just a website!

  • Subscribe to New Scientist and get:

  • New Scientist magazine delivered every week

  • Unlimited online access to articles from over 500 back issues

  • Subscribe Now and Save




If you would like to reuse any content from New Scientist, either in print or online, please contact the syndication department first for permission. New Scientist does not own rights to photos, but there are a variety of licensing options available for use of articles and graphics we own the copyright to.



Have your say

Only subscribers may leave comments on this article. Please log in.


Only personal subscribers may leave comments on this article


Subscribe now to comment.




All comments should respect the New Scientist House Rules. If you think a particular comment breaks these rules then please use the "Report" link in that comment to report it to us.


If you are having a technical problem posting a comment, please contact technical support.