Delivery-Date: Thu, 14 Aug 2014 01:21:37 -0400
Return-Path: <tor-talk-bounces@lists.torproject.org>
X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on moria.seul.org
X-Spam-Level: 
X-Spam-Status: No, score=-4.7 required=5.0 tests=BAYES_00,DKIM_SIGNED,
	RCVD_IN_DNSWL_MED,RP_MATCHES_RCVD,T_DKIM_INVALID autolearn=ham version=3.3.1
X-Original-To: archiver@seul.org
Delivered-To: archiver@seul.org
Received: from eugeni.torproject.org (eugeni.torproject.org [38.229.72.13])
	(using TLSv1.2 with cipher ADH-AES256-GCM-SHA384 (256/256 bits))
	(No client certificate requested)
	by khazad-dum.seul.org (Postfix) with ESMTPS id 8628C1E0E2C;
	Thu, 14 Aug 2014 01:21:35 -0400 (EDT)
Received: from eugeni.torproject.org (localhost [127.0.0.1])
	by eugeni.torproject.org (Postfix) with ESMTP id 992AF30A8A;
	Thu, 14 Aug 2014 05:21:31 +0000 (UTC)
Received: from localhost (localhost [127.0.0.1])
 by eugeni.torproject.org (Postfix) with ESMTP id 49A7E30A8B
 for <tor-talk@lists.torproject.org>; Thu, 14 Aug 2014 05:21:27 +0000 (UTC)
X-Virus-Scanned: Debian amavisd-new at eugeni.torproject.org
Received: from eugeni.torproject.org ([127.0.0.1])
 by localhost (eugeni.torproject.org [127.0.0.1]) (amavisd-new, port 10024)
 with ESMTP id rmK2lrKzUpmt for <tor-talk@lists.torproject.org>;
 Thu, 14 Aug 2014 05:21:27 +0000 (UTC)
Received: from mail-we0-x22c.google.com (mail-we0-x22c.google.com
 [IPv6:2a00:1450:400c:c03::22c])
 (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
 (Client CN "smtp.gmail.com",
 Issuer "Google Internet Authority G2" (not verified))
 by eugeni.torproject.org (Postfix) with ESMTPS id F10E930A58
 for <tor-talk@lists.torproject.org>; Thu, 14 Aug 2014 05:21:26 +0000 (UTC)
Received: by mail-we0-f172.google.com with SMTP id x48so589475wes.17
 for <tor-talk@lists.torproject.org>; Wed, 13 Aug 2014 22:21:24 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
 h=sender:message-id:date:from:user-agent:mime-version:to:subject
 :references:in-reply-to:content-type:content-transfer-encoding;
 bh=vCZMItQuP2Rr/JWyGwN65PSTolrj1EoxEqfgOxO3FkM=;
 b=Wr/qk+Qsy8yOLJnHgceV2LlSsCQPxaLdfNiDTOnj5nPQns/XiIcMCn/KirEKwj+/Yz
 2/8THn48I4nY7tFjbmakNr5XyRSI4/Q/p8IkXgCTlnr3lgUeUwD6UO2sxOpCMMGPapJQ
 VCdr766Z9bNOqg6bIZ/aVo/rztP4gcstjHVxx4niYZk//ZYVWjaJUPgfl3VSQVXZ3fRg
 3RAbOpvukYZFGfqpntesETZnvjTfVd0ZFri6GFIne/LmQVJT7Z9iIzX3X8F4GLW78CFU
 deg8cSVJoV5OPNVL+/M48aJP1B3Q8t2vE7WCVAL5C5fRvj0V/seamus9QPmtdwXt85ap
 wUJw==
X-Received: by 10.195.13.34 with SMTP id ev2mr8487566wjd.55.1407993683984;
 Wed, 13 Aug 2014 22:21:23 -0700 (PDT)
Received: from karstens-air.multi.box
 (dyndsl-031-150-242-225.ewe-ip-backbone.de. [31.150.242.225])
 by mx.google.com with ESMTPSA id ge8sm75609734wib.4.2014.08.13.22.21.22
 for <multiple recipients>
 (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128);
 Wed, 13 Aug 2014 22:21:23 -0700 (PDT)
Message-ID: <53EC4751.1030208@torproject.org>
Date: Thu, 14 Aug 2014 07:21:21 +0200
From: Karsten Loesing <karsten@torproject.org>
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.9;
 rv:24.0) Gecko/20100101 Thunderbird/24.6.0
MIME-Version: 1.0
To: tor-talk@lists.torproject.org
References: <CADop2NHJ7NyDERbbGVOFtMefc=n-f-y86zcpS+8Hc-rcd2sVhA@mail.gmail.com>
 <CADop2NEM4n5ebEdGz_W-Mvk4W6bxa+fe=WHPdQrK2L_41457YQ@mail.gmail.com>
 <38dd2124de8287448ac0f085bd05d3aa@cryptolab.net>
In-Reply-To: <38dd2124de8287448ac0f085bd05d3aa@cryptolab.net>
Subject: Re: [tor-talk] Is there a known tool/script for analyzing the Tor
 consensus files?
X-BeenThere: tor-talk@lists.torproject.org
X-Mailman-Version: 2.1.15
Precedence: list
Reply-To: tor-talk@lists.torproject.org
List-Id: "all discussion about theory, design,
 and development of Onion Routing" <tor-talk.lists.torproject.org>
List-Unsubscribe: <https://lists.torproject.org/cgi-bin/mailman/options/tor-talk>, 
 <mailto:tor-talk-request@lists.torproject.org?subject=unsubscribe>
List-Archive: <http://lists.torproject.org/pipermail/tor-talk/>
List-Post: <mailto:tor-talk@lists.torproject.org>
List-Help: <mailto:tor-talk-request@lists.torproject.org?subject=help>
List-Subscribe: <https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-talk>, 
 <mailto:tor-talk-request@lists.torproject.org?subject=subscribe>
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: 7bit
Errors-To: tor-talk-bounces@lists.torproject.org
Sender: "tor-talk" <tor-talk-bounces@lists.torproject.org>

On 14/08/14 04:34, Griffin Boyce wrote:
> Hey Virgil,
> 
>   The answer depends on what you'd like to do with consensus files. 
> There was (is?) a GSoC project by Daniel Marti in furtherance of
> proposal 140 [2][1], but that's probably not what you're looking for.
> 
>   There's also a script by Moritz Bartl that analyzes consensus files
> and turns them into a KML[3]
> 
>   I might be able to give you a better answer if you can give relevant
> details.

Indeed, there are many tools that analyze consensus files.  The
CollecTor website lists a few applications:

https://collector.torproject.org/#references

If you want to write your own tool to analyze consensus files, take a
look at the available descriptor-parsing libraries:

https://collector.torproject.org/#libraries

Also feel free to search the metrics-tasks Git repo for examples:

https://gitweb.torproject.org/metrics-tasks.git

>   Also, AFAIK, collecTor is just the website [4].

CollecTor has "raw" collected Tor descriptors (including consensuses),
Metrics [5] has aggregate statistics based on these descriptors.  Or,
CollecTor is for machines, Metrics is for humans.

> [1]
> https://gitweb.torproject.org/torspec.git/blob_plain/refs/heads/master:/proposals/140-consensus-diffs.txt
> 
> [2] https://lists.torproject.org/pipermail/tor-dev/2014-May/006792.html
> [2b] https://github.com/mvdan/tor
> [3] https://github.com/moba/tormap
> [4] https://lists.torproject.org/pipermail/tor-dev/2014-June/006942.html
> 
> 
> On 2014-08-13 21:01, Virgil Griffith wrote:
>> And just to be pedantically clear, the data on metrics.torproject.org is
>> computed from the collecTor historical consensus files?

Yes.

>> On Wednesday, August 13, 2014, Virgil Griffith <i@virgil.gr> wrote:
>>
>>> Or, if I were to dream, to highlight the differences between two Tor
>>> consensus files?

This really depends on what differences you're interested in and how you
want them to be highlighted.

All the best,
Karsten

[5] https://metrics.torproject.org/

-- 
tor-talk mailing list - tor-talk@lists.torproject.org
To unsubscribe or change other settings go to
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-talk

