Delivery-Date: Fri, 05 Sep 2014 15:21:30 -0400
Return-Path: <tor-talk-bounces@lists.torproject.org>
X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on moria.seul.org
X-Spam-Level: 
X-Spam-Status: No, score=-4.7 required=5.0 tests=BAYES_00,DKIM_SIGNED,
	RCVD_IN_DNSWL_MED,RP_MATCHES_RCVD,T_DKIM_INVALID autolearn=ham version=3.3.1
X-Original-To: archiver@seul.org
Delivered-To: archiver@seul.org
Received: from eugeni.torproject.org (eugeni.torproject.org [38.229.72.13])
	(using TLSv1.2 with cipher ADH-AES256-GCM-SHA384 (256/256 bits))
	(No client certificate requested)
	by khazad-dum.seul.org (Postfix) with ESMTPS id A55811E0C59;
	Fri,  5 Sep 2014 15:21:28 -0400 (EDT)
Received: from eugeni.torproject.org (localhost [127.0.0.1])
	by eugeni.torproject.org (Postfix) with ESMTP id 15440283BB;
	Fri,  5 Sep 2014 19:21:23 +0000 (UTC)
Received: from localhost (localhost [127.0.0.1])
 by eugeni.torproject.org (Postfix) with ESMTP id CDC67285E2
 for <tor-talk@lists.torproject.org>; Fri,  5 Sep 2014 19:21:19 +0000 (UTC)
X-Virus-Scanned: Debian amavisd-new at eugeni.torproject.org
Received: from eugeni.torproject.org ([127.0.0.1])
 by localhost (eugeni.torproject.org [127.0.0.1]) (amavisd-new, port 10024)
 with ESMTP id 8AP3WyH17uAI for <tor-talk@lists.torproject.org>;
 Fri,  5 Sep 2014 19:21:19 +0000 (UTC)
Received: from mail-we0-x234.google.com (mail-we0-x234.google.com
 [IPv6:2a00:1450:400c:c03::234])
 (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
 (Client CN "smtp.gmail.com",
 Issuer "Google Internet Authority G2" (not verified))
 by eugeni.torproject.org (Postfix) with ESMTPS id 86BC626369
 for <tor-talk@lists.torproject.org>; Fri,  5 Sep 2014 19:21:19 +0000 (UTC)
Received: by mail-we0-f180.google.com with SMTP id w61so12225615wes.25
 for <tor-talk@lists.torproject.org>; Fri, 05 Sep 2014 12:21:16 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
 h=sender:message-id:date:from:user-agent:mime-version:to:subject
 :references:in-reply-to:content-type:content-transfer-encoding;
 bh=Li+3nt7CjNxaecbp9DOanJwRYX9cV8K/1Gu1FJ9FD+4=;
 b=IA6DsOdvhzzviWC2cpreqlnk9Uuh101YnUAPh853KkTIAW5XtoyYUozQ7KiAjJlnWI
 A0Qn4mzaM4JcUkcx6pGEHDflWm35X7m7KfJtxg+UM5gPuHpUyS7QHqJe/a6/tEWAHNE7
 mmQwXwuiESFir6zuvd68d98vR0RBclVG1fUqdr1bYLA+XT95nbhmC/uAmRF8ezlQRh2B
 ki38ii8ULX+hpwlKXQdc4LzQIUL1ZN9k0QFfwcvc3mDo1KlH46lZKY65hCyVbFEVczdo
 E4ww7cfPJFRlpPxk+NpBce2i4zf65QG7HJJ0s/9MVPxMQF4savcn0ki1NkjUVAeGOmqt
 1EBg==
X-Received: by 10.180.24.35 with SMTP id r3mr5643279wif.71.1409944876554;
 Fri, 05 Sep 2014 12:21:16 -0700 (PDT)
Received: from karstens-air.multi.box
 (dyndsl-031-150-149-254.ewe-ip-backbone.de. [31.150.149.254])
 by mx.google.com with ESMTPSA id ua8sm2371282wjc.7.2014.09.05.12.21.14
 for <multiple recipients>
 (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128);
 Fri, 05 Sep 2014 12:21:15 -0700 (PDT)
Message-ID: <540A0D29.9010605@torproject.org>
Date: Fri, 05 Sep 2014 21:21:13 +0200
From: Karsten Loesing <karsten@torproject.org>
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.9;
 rv:24.0) Gecko/20100101 Thunderbird/24.6.0
MIME-Version: 1.0
To: tor-talk@lists.torproject.org
References: <4C50B076-9535-4149-82DB-DAD05466AD50@fikuart.com>
In-Reply-To: <4C50B076-9535-4149-82DB-DAD05466AD50@fikuart.com>
Subject: Re: [tor-talk] GEOIP's
X-BeenThere: tor-talk@lists.torproject.org
X-Mailman-Version: 2.1.15
Precedence: list
Reply-To: tor-talk@lists.torproject.org
List-Id: "all discussion about theory, design,
 and development of Onion Routing" <tor-talk.lists.torproject.org>
List-Unsubscribe: <https://lists.torproject.org/cgi-bin/mailman/options/tor-talk>, 
 <mailto:tor-talk-request@lists.torproject.org?subject=unsubscribe>
List-Archive: <http://lists.torproject.org/pipermail/tor-talk/>
List-Post: <mailto:tor-talk@lists.torproject.org>
List-Help: <mailto:tor-talk-request@lists.torproject.org?subject=help>
List-Subscribe: <https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-talk>, 
 <mailto:tor-talk-request@lists.torproject.org?subject=subscribe>
Content-Type: text/plain; charset="windows-1252"
Content-Transfer-Encoding: quoted-printable
Errors-To: tor-talk-bounces@lists.torproject.org
Sender: "tor-talk" <tor-talk-bounces@lists.torproject.org>

On 05/09/14 19:00, Mike Fikuart wrote:
> Hi Group,
> =

> I am looking into the various files used by the OR=92s and OP=92s and
> would like to know more about the GEOIP file and use.  I have already
> seen in the
> dir-spec<https://gitweb.torproject.org/torspec.git/blob/HEAD:/dir-spec.tx=
t#l1522>
> document that these GEOIP=92s are created in the =93Extra-info=94 document
> and relate to country codes for bridges and in turn was referred to
> the
> blocking.pdf<https://svn.torproject.org/svn/projects/design-paper/blockin=
g.pdf>
> document, which went a bit further in the same vein.
> =

> The blocking.pdf (Design of a blocking-resistant anonymity system,
> Tor Project technical report, Nov 2006) suggests "the compressed
> GEOIP database is only a few hundred kilobytes=94, but the geoip file
> on my relay is about 2MB.  Is this just because it is decompressed,
> now a much larger DB or is not the DB being referred to in the
> document?
> =

> The geoip file has 82,363 different Country Code entries listed.
> What do they relate to, as this would far exceed the bridges and
> relays?
> =

> I seem to remember (but now cannot find the reference) that the
> geoip=92s have been responsible for improving the routing of data or
> selection of relays for circuits.  Is this correct and how does this
> work?
> =

> I would appreciate an explanation or a point in the direction of the
> appropriate documentation, thanks.

The geoip file is used by clients that wish to include/exclude relays by
country to know where relays are located.  It's also used by relays to
report aggregate statistics on usage by country.

You can find the current geoip file here:

https://gitweb.torproject.org/tor.git/blob/HEAD:/src/config/geoip

The first few lines tell you how this file is generated:

# Last updated based on August 7 2014 Maxmind GeoLite2 Country
# wget
https://geolite.maxmind.com/download/geoip/database/GeoLite2-Country.mmdb.gz
# gunzip GeoLite2-Country.mmdb.gz
# python mmdb-convert.py GeoLite2-Country.mmdb

See also the MaxMind website for details what's contained in their database.

Regarding database size, here's what happens when I compress the geoip file:

-rw-r--r--  1 karsten  staff   2.2M Sep  5 21:18 geoip
-rw-r--r--  1 karsten  staff   678K Sep  5 21:18 geoip.bz2
-rw-r--r--  1 karsten  staff   688K Sep  5 21:18 geoip.gz
-rw-r--r--  1 karsten  staff   402K Sep  5 21:18 geoip.xz

Not sure if this answers all your questions, but maybe it's a start.

All the best,
Karsten
-- =

tor-talk mailing list - tor-talk@lists.torproject.org
To unsubscribe or change other settings go to
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-talk

