Delivery-Date: Wed, 11 Jun 2014 14:56:43 -0400
Return-Path: <tor-talk-bounces@lists.torproject.org>
X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on moria.seul.org
X-Spam-Level: 
X-Spam-Status: No, score=-4.8 required=5.0 tests=BAYES_00,RCVD_IN_DNSWL_MED,
	RP_MATCHES_RCVD,UNPARSEABLE_RELAY autolearn=ham version=3.3.1
X-Original-To: archiver@seul.org
Delivered-To: archiver@seul.org
Received: from eugeni.torproject.org (eugeni.torproject.org [38.229.72.13])
	(using TLSv1.2 with cipher ADH-AES256-GCM-SHA384 (256/256 bits))
	(No client certificate requested)
	by moria.seul.org (Postfix) with ESMTPS id 3B2181E0AA5
	for <archiver@seul.org>; Wed, 11 Jun 2014 14:56:41 -0400 (EDT)
Received: from eugeni.torproject.org (localhost [127.0.0.1])
	by eugeni.torproject.org (Postfix) with ESMTP id 3F25C2F8B7;
	Wed, 11 Jun 2014 18:56:40 +0000 (UTC)
Received: from localhost (localhost [127.0.0.1])
 by eugeni.torproject.org (Postfix) with ESMTP id 518482FB52
 for <tor-talk@lists.torproject.org>; Wed, 11 Jun 2014 18:42:43 +0000 (UTC)
X-Virus-Scanned: Debian amavisd-new at eugeni.torproject.org
Received: from eugeni.torproject.org ([127.0.0.1])
 by localhost (eugeni.torproject.org [127.0.0.1]) (amavisd-new, port 10024)
 with ESMTP id 3Axx53fnQ050 for <tor-talk@lists.torproject.org>;
 Wed, 11 Jun 2014 18:42:43 +0000 (UTC)
Received: from mx1.riseup.net (mx1.riseup.net [198.252.153.129])
 (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits))
 (Client CN "*.riseup.net", Issuer "Gandi Standard SSL CA" (not verified))
 by eugeni.torproject.org (Postfix) with ESMTPS id 2E8CE2F699
 for <tor-talk@lists.torproject.org>; Wed, 11 Jun 2014 18:42:43 +0000 (UTC)
Received: from fulvetta.riseup.net (fulvetta-pn.riseup.net [10.0.1.75])
 (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits))
 (Client CN "*.riseup.net", Issuer "Gandi Standard SSL CA" (not verified))
 by mx1.riseup.net (Postfix) with ESMTPS id 09FDF53C3C
 for <tor-talk@lists.torproject.org>; Wed, 11 Jun 2014 11:42:40 -0700 (PDT)
Received: from [127.0.0.1] (localhost [127.0.0.1])
 (Authenticated sender: mirimir@fulvetta.riseup.net)
 with ESMTPSA id 37EA62FC
Message-ID: <5398A328.7080001@riseup.net>
Date: Wed, 11 Jun 2014 12:42:48 -0600
From: Mirimir <mirimir@riseup.net>
User-Agent: Mozilla/5.0 (X11; Linux x86_64;
 rv:24.0) Gecko/20100101 Thunderbird/24.5.0
MIME-Version: 1.0
To: tor-talk@lists.torproject.org
References: <CAD2Ti28+Qp6mWSgFizXkiNCe1+Keo3hbj6j83j24cXY=EwRHAA@mail.gmail.com>
 <5397ABA1.3050502@torproject.is>
 <1402455312.53419.YahooMailNeo@web140806.mail.bf1.yahoo.com>
 <5397CFD8.2060406@riseup.net>
 <CAD2Ti28RAkmxc76LPHjhYgbrOP=5Aqf3uWcQq4yq+64RT5heyA@mail.gmail.com>
 <53981F4D.7030609@riseup.net>
 <CAD2Ti28n+Wz48OHX+zBMft-nagw5tGjt9QQenMoe__VyFW5DCA@mail.gmail.com>
In-Reply-To: <CAD2Ti28n+Wz48OHX+zBMft-nagw5tGjt9QQenMoe__VyFW5DCA@mail.gmail.com>
X-Enigmail-Version: 1.6
X-Virus-Scanned: clamav-milter 0.98.1 at mx1
X-Virus-Status: Clean
Subject: Re: [tor-talk] Norse Darklist, for blocking Tor
X-BeenThere: tor-talk@lists.torproject.org
X-Mailman-Version: 2.1.15
Precedence: list
Reply-To: tor-talk@lists.torproject.org
List-Id: "all discussion about theory, design,
 and development of Onion Routing" <tor-talk.lists.torproject.org>
List-Unsubscribe: <https://lists.torproject.org/cgi-bin/mailman/options/tor-talk>, 
 <mailto:tor-talk-request@lists.torproject.org?subject=unsubscribe>
List-Archive: <http://lists.torproject.org/pipermail/tor-talk/>
List-Post: <mailto:tor-talk@lists.torproject.org>
List-Help: <mailto:tor-talk-request@lists.torproject.org?subject=help>
List-Subscribe: <https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-talk>, 
 <mailto:tor-talk-request@lists.torproject.org?subject=subscribe>
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: 7bit
Errors-To: tor-talk-bounces@lists.torproject.org
Sender: "tor-talk" <tor-talk-bounces@lists.torproject.org>

On 06/11/2014 12:10 PM, grarpamp wrote:
> On Wed, Jun 11, 2014 at 5:20 AM, Mirimir <mirimir@riseup.net> wrote:
>>>> Well, we can create a blacklist of sites that block Tor ;)
>>>
>> No. I just mean a list of sites that block Tor in some way.
> 
> There's a wiki page for all this, and both of these forms...
> 
>>> You mean an exitpolicy blacklist of blocklists (list providers),
> 
> https://trac.torproject.org/projects/tor/wiki/org/doc/ListOfServicesBlockingTor
> Under "List Of RBL Lists"...
> 
>>> not of subscribing (or homegrown blocking) end sites.
> 
> https://trac.torproject.org/projects/tor/wiki/org/doc/ListOfServicesBlockingTor
> Under "List Of Services Blocking Tor"...

OK, thanks. I'll submit results there.

>> I'm finding, by the way, that craigslist takes about six minutes to load
> 
> 'slow' blocking rough maximum, avg exit is much less.
> 
>> via Tor, from a VM where most of the other top 50 sites load in 5-20
> 
> normal.
> 
>> seconds. Another ten sites refuse to load. I haven't determined why yet.
> 
> probably blocking.

Some detect that I'm doing console-level snapshot, and throw errors.
Some of the errors may be CAPTCHAs. Imgur invites me to apply for a job,
given that I use the console ;)

> If your scripts are anything like before, you're going to need to
> use the controller to manage exits, otherwise your data will
> be left to the randomness of tor. That's fine to find random things,
> but not very narrow to discover/test specific repeatable anomalies.
> Lock down to a single exit (possibly chosen at random) for each
> test run, or cycle a site through all exits (for which you will need
> at least 7 tors to finish one 'slow' site in 4 hours).

I prefer using random exits with random timing, because that looks more
like normal user behavior. What I need is a normal-seeming snapshot
method, and a way of explicitly flagging CAPTCHA challenges. Once I
finish working out the kinks, I'll post the scripts somewhere.

The server that I'm using can handle 10-20 VMs testing in parallel, and
they can run 24/7 as long as it takes. I could do it faster, but that
would stand out too much as testing.
-- 
tor-talk mailing list - tor-talk@lists.torproject.org
To unsubscribe or change other settings go to
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-talk

