The momentum for a Montreal Open Data portal is building. An initiative called MontrealOuvert recently held their first meeting and grabbed the attention of The Gazette and MontrealTech.net.

To help demonstrate how citizens can easily add value to city data when it's openly published, I've just created DéchetsMontreal (www.dechetsmontreal.ca). Using text-based trash schedule data -- one of the few data sets currently available of the City of Montreal website -- DéchetsMontreal adds additional features to allow you to view calendars of the schedules, and to import them into applications such as Google Calendar and Apple iCalendar.

Open data is not only important to allow citizens and communities to create innovative applications, but is also vital to researchers. The availability of government data enables statisticians, cartographers, and other researchers to reuse publicly-funded data sets without wasting resources by duplicating work for which the public has already paid. Open data is also an important step towards increasing government transparency. Providing citizens access to the data on which government representatives and officials base their decisions allows citizens to make informed decisions. It allows us to more fully engage and participate in our government and its processes.

Hopefully we'll the City of Montreal follow the lead of other Canadian cities, including Vancouver, Ottawa, Toronto, Nanaimo, Edmonton, and bring us an open data portal soon!

E-Books and Your Privacy

By: kent

9 Sep 2010

EFF recently posted an interesting overview of how each of the major e-book distributors logs your data, and how each treats information related to the books that you purchase.

It appears the article is no longer available, so I've reproduced the main chart below (the content is licensed under CC):

Can they keep track of book searches?

Google Books Yes Logs all search data with IP address. Will also associate searches with user's Google Account if logged in. Will not associate searches with users account if not logged in.
Amazon Kindle Yes Logs data on products viewed and/or searched for on the device, and associates info with Amazon account. Searches inside book require login to account which associates with credit card information.
B&N Nook Yes The privacy policy is unclear about whether searches made on the Nook are recorded, but B&N generally logs data on searches made and pages viewed on B&N website. B&N does not disclose whether it associates book searches with a user's account if logged in.
Sony Reader Yes/No The privacy policy is unclear, but if a customer uses the Reader Store, Sony will log IP address and message information, and can associate data with the Reader Store account (must be logged in to browse store).
FBReader No FBReader does not collect data about book searches.
Internet Archive No The Archive does not collect IP addresses/user-identifiable data about book searches
iPad Yes/No Yes if purchased from iBookstore or other Apple applications; otherwise no.
 

Can they monitor what you're reading after purchase and link back to you?

Google Books Yes Logs specific book and page viewed on website.
Amazon Kindle Yes Exact parameters of information logged is unclear, but includes books and pages read.
B&N Nook Unkown It does not appear that B&N can monitor reading after purchase, but the Privacy Policy and various applicable terms of use are unclear.
Sony Reader No Sony does not record info about content on device.
FBReader No FBReader does not collect information from users.
Internet Archive No The Archive does not collect user-specific information (including IP addresses) about what is read/downloaded. If, however, a user makes use of the Archive’s bookmark feature, it will by definition associate that item with the user’s account. A forthcoming lending library of modern books will retain some user information for a time to implement the system – the extent of information to be collected and the duration over which it will be stored are yet to be determined.
iPad No Terms of Use claim that any information gathered is non-identifiable.
 

Is the device ONLY compatible with books purchased from an associated eBook store?

Google Books N/A The Google Books service is not a reading device, but does allow downloads of public domain books in unprotected PDF or EPUB. Other books must be read online through Google's web interface.
Amazon Kindle Yes Only Amazon's proprietary AZW and unprotected TXT, MOBI, PRC files are directly compatible with Kindle. Kindles also have PDF support. Amazon also now allows publishers to offer books without DRM.
B&N Nook No Supports popular eBook formats like EPUB and PDF from other sources (if Adobe DRM or non-DRM), BUT they will not be compatible with many Nook features. Does not support AZW.
Sony Reader No Supports books in multiple DRM formats including EPUB (Adobe), PDF (Adobe), and BBeB book (PRS) in addition to non-DRM formats. Does not support AZW.
FBReader No Supports a wide variety of open, non-DRM versions of formats like EPUB, FB2, MOBI, PRC, OEB, etc. Does not support PDF or AZW.
Internet Archive N/A Internet Archive’s text collection is not a reading device, but is compatible with many different devices. Among the formats offered are PDF, EPUB, MOBI, Daisy (for sight-impaired/print-disabled), DJVU and OCR-generated txt formats.
iPad No Supports EPUB and PDFs. Supports AZW with additional software.
 

Can they keep track of book purchases?

Google Books Yes All book purchases must be associated with a Google Account.
Amazon Kindle Yes Amazon will compile a purchase history for users.
B&N Nook Yes For purchases from the B&N eBook Store, the privacy policy is unclear. B&N says it will associate book purchases with the user when he or she enrolls in a membership loyalty program, but it is silent as to whether purchases are associated with a B&N online account. B&N does not keep track of books obtained elsewhere that are read on the device.
Sony Reader Yes While the privacy policy is unclear, Sony appears to keep track of purchases from the Reader Store since the user must log in to purchase books and Sony assigns a identification cookie to users for licensing purposes. Sony does not keep track of books obtained elsewhere that are read on the device.
FBReader No FBReader does not collect data about book purchases.
Internet Archive N/A The Archive does not sell books, but some of its associated sites (e.g., www.openlibrary.org) link to bookstores.
iPad Yes/No Yes if searched on iBookstore or other Apple applications; otherwise no.
 

With whom can they share the information collected in non-aggregated form?

Google Books Law enforcement, civil litigants and within Google's own products.
Amazon Kindle Law enforcement, civil litigants and within Amazon's own products.
B&N Nook For information collected through the B&N eBook Store: law enforcement, civil litigants and within B&N's own products.
Sony Reader For information collected through the Reader Store: law enforcement, civil litigants, within Sony's own products, and with Borders, its Reader Store partner.
FBReader N/A No information is collected.
Internet Archive N/A The Archive does not collect user-specific information (including IP address) about the searching, reading, or downloading of texts. Books, bookmarks, reviews, and forum postings are publicly available.
iPad N/A Law enforcement or civil litigants as required by law, Apple's service providers, vendors and strategic partners within Apple Group.
 

Can they share information outside the company without the customer's consent?

Google Books No User must opt-in to have personal info shared outside Google.
Amazon Kindle Yes Users may opt-out of use of information only for certain promotional and marketing purposes.
B&N Nook Yes Users may opt-out of use of information only for certain promotional and marketing purposes or for certain analytic uses of info by third parties.
Sony Reader Yes For information collected through the Reader Store: User may refuse to share information (on either an opt-out or opt-in basis) only for promotional or marketing purposes. To opt-out of further sharing of information by Borders, which operates the Reader Store, user must contact Borders directly.
FBReader No No information is collected.
Internet Archive N/A The Archive does not collect user-specific information (including IP address) about the searching, reading, or downloading of texts. Books, bookmarks, reviews, and forum postings are publicly available.
iPad Yes Users may opt out of use of information only for certain marketing and personalized advertising uses.
 

Do they lack mechanisms for customers to access, correct, or delete the information?

Google Books No User may delete or disassociate book titles with account, but may lose ability to read them. Users can delete their search history.
Amazon Kindle Somewhat Users may access and update info in account profile, but Amazon may retain prior versions for its records. There is no right to access or delete search and purchase history.
B&N Nook Somewhat Users may access, correct, and change info in account profile at any time. There is no right to access or delete search and purchase history.
Sony Reader Somewhat For information collected through the Reader Store: Users may send a request to have certain personal information updated and it will be done in a reasonable time. There is no right to access or delete search and purchase history.
FBReader No No information is collected.
Internet Archive No No user info/IP addresses on searches/reading/downloads are collected. Bookmarks may be deleted.
iPad Somewhat Users may delete book titles within personal account but will likely lose ability to read them. There is no right to access or delete search and purchase history.

Updated 3/5/10: Added Internet Archive information.

The answer:

<Test temporarily unavailable>

If the image above warns, "Yes, you are being tracked", then advertising companies are most certainly tracking you from website to website as you browse the internet.

To the chagrin of myself and others, your web browser allows advertising companies to place "third-party" tracking cookies on your computer by default. Unless you have changed the default settings for your browser, you will get this warning.

The reality is that these third party cookies have little practical use, other than for advertising companies to track you. In most cases there is simply no need for your browser to allow advertising companies to place cookies. The vast majority of websites will function properly, with no adverse affects, if third party cookies are disabled altogether.

For further details on third party cookies,please see my recent post on Digital Agenda where I explain the issue in further detail (albeit without the fancy image gimmick above!).

Without a doubt, many Canadian readers have been frustrated to find that a particular television show is available on the American iTunes, but not the Canadian one, and surely other readers have tried to watch a show at Hulu.com only to find that Canadians are barred from these videos altogether.

This situation has nothing to do with Canadian broadcasting laws, and everything to do with big-money exclusive distribution agreements between Canadian broadcasters and the Hollywood corporations that produce television content. So much for the economic efficiencies of a global marketplace when these oligopolies see fit to set prices in Canada half again as high as in the United States, even when the leveling power of the internet makes the costs of distribution the same in each country.

Fortunately, you can legally circumvent "locational discrimination" by proxying through an American server. This won't work for the American iTunes, which verifies your location based on your credit card, but will work for free sites such as Hulu.com. With a little bit of side-stepping the regular Amazon.com payment services by purchasing gift certificates with a Canadian credit card and using them with an American account, proxying will also work for Amazon.com Video On Demand.

Proxying so as to pretend your an American is perfectly legal. The only slightly grey area of this process is that, depending on the webite you visit, you may end up breaching the website Terms of Use. For example, Hulu.com states that "[u]sing technologies to access the Content from territories where Hulu does not have rights or does not offer services is prohibited."

However, breach of a contractual term is not to be confused with breaking the law. Modern contract law is prevalently informed by the theory of efficient breach, which allows any contract to be broken so as to maximize overall economic efficiency. Jargon aside, this means that you have the right to break a contract. The consequence, under the common law, is simply that you are then bound by a secondary obligation to pay for any damages that you cause.

What's the damage caused by downloading a television show from the United States? I can't think of any obvious damage. If anything, the site your visiting achieves positive gains by you paying for a video, or by you watching their advertisements -- rather than you illegally downloading the video from Bit Torrent. Granted, if large numbers of Canadians downloaded television content from the U.S., this could diminish the prospects of future exclusive deals between Canadian broadcasters and Hollywood. However, these parties are not privy to your contract with the website that you visit. Arguably, there is a remote possibility that this could be considered a "tortious interference of contract", but this tort usually has a very high bar for establishing wrongdoing.

As with any legal technicality, there are also moral considerations. It's up to you decide whether it is morally wrong to break a contractual promise--one which you probably didn't even know that you made--to a corporation that is trying to a draw a bright line across national boundaries that the internet is supposed to transcend.

You should be in the clear, legally speaking. Now for the technology side of the equation. Most of these sites use Flash to detect your real IP address, and thus your location. Flash by-passes your browser's proxy settings. Directly entering a proxy in your browser settings, or using a tool such as FoxyProxy, won't do the trick.

First, you need to download a tool that directs all of your internet traffic through a proxy (and not only your web browser traffic). For Windows, your best bet is AllProxy Lite (30 day free trial, $10 after) or Proxifier ($30 day free trial, $40 after). I'll assume the use of AllProxy for the remainder of these instructions and explanations, but the setup is similar for Proxifier.

The second item you need is a SOCKS 5 proxy server in the United States. If you happen to have a web server in the U.S., then you're set. You can use Putty to setup a SOCKS 5 server that works through your SSH connection. However, likely you don't! You'll have to use a third-party proxy service.

Although there are many free SOCKS 5 proxy servers, most will be too slow to support streaming video. However, there are many pay services that offer reasonable bandwidth for around $7-10 per month. Ensure that any service you choose supports SOCKS, and not just HTTP proxy. Two such services that I'm aware of are Proxybonanza and Proxylicious).

Once you've signed up for a proxy service and downloaded your proxy application, here's how to configure it:

  1. Open AllProxy Lite (or another proxy application).
  2. Open the Proxy Options from Proxies List -> Add Proxy. Enter the IP Address, port and login (if any) of your proxy service. Select "SOCK 5".
  3. proxy_1.jpg

  4. In the main AllProxy Lite window, click Change and select the proxy you just added from the dropdown.
  5. That's it! You are now an American as far as any website is concerned.

Hopefully American content creators will soon realize that they're losing valuable marketing prospects for internet sales when they sign extensive exclusive distribution contracts in Canada. Until then...enjoy the show.