Delivery-Date: Wed, 21 Jan 2015 08:04:59 -0500
Return-Path: <tor-talk-bounces@lists.torproject.org>
X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on moria.seul.org
X-Spam-Level: 
X-Spam-Status: No, score=-4.7 required=5.0 tests=BAYES_00,DKIM_ADSP_CUSTOM_MED,
	DKIM_SIGNED,FREEMAIL_FROM,RCVD_IN_DNSWL_MED,RP_MATCHES_RCVD,T_DKIM_INVALID,
	URIBL_BLOCKED autolearn=ham version=3.3.1
X-Original-To: archiver@seul.org
Delivered-To: archiver@seul.org
Received: from eugeni.torproject.org (eugeni.torproject.org [38.229.72.13])
	(using TLSv1.2 with cipher ADH-AES256-GCM-SHA384 (256/256 bits))
	(No client certificate requested)
	by khazad-dum.seul.org (Postfix) with ESMTPS id 0E8EC1E0399
	for <archiver@seul.org>; Wed, 21 Jan 2015 08:04:58 -0500 (EST)
Received: from eugeni.torproject.org (localhost [127.0.0.1])
	by eugeni.torproject.org (Postfix) with ESMTP id AD8A333919;
	Wed, 21 Jan 2015 13:04:54 +0000 (UTC)
Received: from localhost (localhost [127.0.0.1])
 by eugeni.torproject.org (Postfix) with ESMTP id CB8A133887
 for <tor-talk@lists.torproject.org>; Wed, 21 Jan 2015 13:04:50 +0000 (UTC)
X-Virus-Scanned: Debian amavisd-new at 
Received: from eugeni.torproject.org ([127.0.0.1])
 by localhost (eugeni.torproject.org [127.0.0.1]) (amavisd-new, port 10024)
 with ESMTP id rNReSWWTF-2M for <tor-talk@lists.torproject.org>;
 Wed, 21 Jan 2015 13:04:50 +0000 (UTC)
Received: from mail-wg0-x22c.google.com (mail-wg0-x22c.google.com
 [IPv6:2a00:1450:400c:c00::22c])
 (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
 (Client CN "smtp.gmail.com",
 Issuer "Google Internet Authority G2" (not verified))
 by eugeni.torproject.org (Postfix) with ESMTPS id 81081338D1
 for <tor-talk@lists.torproject.org>; Wed, 21 Jan 2015 13:04:50 +0000 (UTC)
Received: by mail-wg0-f44.google.com with SMTP id z12so6000226wgg.3
 for <tor-talk@lists.torproject.org>; Wed, 21 Jan 2015 05:04:47 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
 h=message-id:date:from:user-agent:mime-version:to:subject:references
 :in-reply-to:content-type:content-transfer-encoding;
 bh=P2GNa/8lC0EpHVUPdWeH7PGRAX4Wmv2WZ2uaDzKpEYE=;
 b=F7pfr/8xsTudjekivhhvLF9RDhA8+5pPuCwgJ4ftqJN8GDdLKff48NTs6vA2bhEsLL
 ycQUVN69A3ib3J5vh25O3jsnO1e9cVeqh+P9Lbz9A06D+uy2ZT9pbQZtDnomHpTLUetw
 aVgkDhRBqPNf7LtOnJmHlH/tZDWRu/7ysn4HFftzEmaWY1M/TYQy6rDbC5S/wghpOZbZ
 w2Ocu6MlbDHZ/8d6W5NJFiNVKFoI6E0+SLN/yWDBGKtGThDjoPG4PNyBS02HlYs8QtgI
 CwVZo50DoTJwza4klqOaaoOI1Eb43ANcDjMEWuY+0I5yY+nXWAa9jqfPlOYxB8ZKH5KQ
 oFXw==
X-Received: by 10.181.12.11 with SMTP id em11mr56783626wid.1.1421845483332;
 Wed, 21 Jan 2015 05:04:43 -0800 (PST)
Received: from [192.168.1.11] (ANice-652-1-21-198.w83-201.abo.wanadoo.fr.
 [83.201.156.198])
 by mx.google.com with ESMTPSA id qg11sm7199882wic.17.2015.01.21.05.04.41
 for <tor-talk@lists.torproject.org>
 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128);
 Wed, 21 Jan 2015 05:04:42 -0800 (PST)
Message-ID: <54BFA3F2.9030706@gmail.com>
Date: Wed, 21 Jan 2015 14:04:50 +0100
From: Aymeric Vitte <vitteaymeric@gmail.com>
User-Agent: Mozilla/5.0 (Windows NT 6.3;
 rv:31.0) Gecko/20100101 Thunderbird/31.4.0
MIME-Version: 1.0
To: tor-talk@lists.torproject.org
References: <54BEB7AB.7090401@umail.iu.edu>
 <20150120202427.GB30692@moria.seul.org>
In-Reply-To: <20150120202427.GB30692@moria.seul.org>
Subject: Re: [tor-talk] Yelp blocking Tor users from viewing entire site
X-BeenThere: tor-talk@lists.torproject.org
X-Mailman-Version: 2.1.15
Precedence: list
Reply-To: tor-talk@lists.torproject.org
List-Id: "all discussion about theory, design,
 and development of Onion Routing" <tor-talk.lists.torproject.org>
List-Unsubscribe: <https://lists.torproject.org/cgi-bin/mailman/options/tor-talk>, 
 <mailto:tor-talk-request@lists.torproject.org?subject=unsubscribe>
List-Archive: <http://lists.torproject.org/pipermail/tor-talk/>
List-Post: <mailto:tor-talk@lists.torproject.org>
List-Help: <mailto:tor-talk-request@lists.torproject.org?subject=help>
List-Subscribe: <https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-talk>, 
 <mailto:tor-talk-request@lists.torproject.org?subject=subscribe>
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain; charset="windows-1252"; Format="flowed"
Errors-To: tor-talk-bounces@lists.torproject.org
Sender: "tor-talk" <tor-talk-bounces@lists.torproject.org>

It would be interesting to know if sites like Yelp/Craiglists are more =

afraid of anonymity and possible spam/trolls than crawlers.

If they cannot detect a crawler using Tor, then they cannot detect any =

other crawler, like a crawler switching IPs as mentionned in another =

post, using vpns or proxies, etc

So in that case it's useless to block Tor, because Tor network's size is =

not really significant compared to other means that crawlers have, =

probably they just choosed the easy way as well as crawlers might have =

chosen the easy way too (use Tor), blocking Tor so they have solved one =

problem.

But in fact they have solved nothing if they are not protected against =

crawlers, and if they are protected the protection would be something =

like blocking the IP or sending a captcha.

Maybe the exit nodes could implement an anti-crawler feature, even if =

the crawler is switching among 1000 exit nodes I think it's feasible to =

fingerprint it in the Tor network finite space, I don't know if there =

are studies about this, an efficient crawler can never behave like a =

human being or a normal browser.

This might sound like a kind of censorship but that's probably not the =

goal of the Tor network to crawl and spam the web, the exit nodes that =

would have removed the feature would just get blocked.

Le 20/01/2015 21:24, Roger Dingledine a =E9crit :
> On Tue, Jan 20, 2015 at 03:16:43PM -0500, Greg Norcie wrote:
>> So today I noticed Yelp appears to be blocking Tor.
>>
>> I tried using multiple identities, but get a 503 error every time.
>>
>> Anyone else have this issue?
>>
>> This seems really overbroad... I could understand the argument
>> against letting a Tor user post reviews, but to disallow simple
>> browsing seems like overkill.
> See their two mentions in
> https://blog.torproject.org/blog/call-arms-helping-internet-services-acce=
pt-anonymous-users
>
> I think Yelp blocks Tor for a similar reason to why Craigslist blocks
> Tor -- their value-add is their web pages, and if their competitors
> "steal" their web pages, they've got nothing else.
>
> That kind of business model leads to jealously guarding all of their
> pages from being crawled or otherwise viewed en masse -- which in turn
> leads to being angry and bitter at every new Internet technology.
>
> Unfortunately, since this business model is so fragile, I don't have
> good ideas on how to make it compatible with Tor (or heck, with most
> of the rest of the Internet).
>
> --Roger
>

-- =

Peersm : http://www.peersm.com
torrent-live: https://github.com/Ayms/torrent-live
node-Tor : https://www.github.com/Ayms/node-Tor
GitHub : https://www.github.com/Ayms

-- =

tor-talk mailing list - tor-talk@lists.torproject.org
To unsubscribe or change other settings go to
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-talk

