Delivery-Date: Wed, 11 Mar 2015 13:55:08 -0400
Return-Path: <tor-talk-bounces@lists.torproject.org>
X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on moria.seul.org
X-Spam-Level: 
X-Spam-Status: No, score=-4.2 required=5.0 tests=BAYES_00,RCVD_IN_DNSWL_MED,
	T_RP_MATCHES_RCVD,URIBL_BLOCKED autolearn=ham version=3.3.1
X-Original-To: archiver@seul.org
Delivered-To: archiver@seul.org
Received: from eugeni.torproject.org (eugeni.torproject.org [38.229.72.13])
	(using TLSv1.2 with cipher ADH-AES256-GCM-SHA384 (256/256 bits))
	(No client certificate requested)
	by khazad-dum.seul.org (Postfix) with ESMTPS id C8CDE1E0455
	for <archiver@seul.org>; Wed, 11 Mar 2015 13:55:06 -0400 (EDT)
Received: from eugeni.torproject.org (localhost [127.0.0.1])
	by eugeni.torproject.org (Postfix) with ESMTP id 0EE2F347D0;
	Wed, 11 Mar 2015 17:54:59 +0000 (UTC)
Received: from localhost (localhost [127.0.0.1])
 by eugeni.torproject.org (Postfix) with ESMTP id 30459347D2
 for <tor-talk@lists.torproject.org>; Wed, 11 Mar 2015 17:54:55 +0000 (UTC)
X-Virus-Scanned: Debian amavisd-new at 
Received: from eugeni.torproject.org ([127.0.0.1])
 by localhost (eugeni.torproject.org [127.0.0.1]) (amavisd-new, port 10024)
 with ESMTP id yZlIJM3EEq6p for <tor-talk@lists.torproject.org>;
 Wed, 11 Mar 2015 17:54:55 +0000 (UTC)
Received: from mira.cbaines.net (li622-129.members.linode.com [212.71.249.129])
 by eugeni.torproject.org (Postfix) with ESMTP id EB0CD347C2
 for <tor-talk@lists.torproject.org>; Wed, 11 Mar 2015 17:54:54 +0000 (UTC)
X-Greylist: delayed 321 seconds by postgrey-1.34 at eugeni;
 Wed, 11 Mar 2015 17:54:54 UTC
Received: from [192.168.0.5] (cpc1-sotn14-2-0-cust118.15-1.cable.virginm.net
 [81.96.148.119])
 by mira.cbaines.net (Postfix) with ESMTPSA id C7C45212A2B
 for <tor-talk@lists.torproject.org>; Wed, 11 Mar 2015 17:49:03 +0000 (GMT)
Message-ID: <5500800C.6080507@cbaines.net>
Date: Wed, 11 Mar 2015 17:49:00 +0000
From: Christopher Baines <mail@cbaines.net>
User-Agent: Mozilla/5.0 (X11; Linux x86_64;
 rv:34.0) Gecko/20100101 Icedove/34.0
MIME-Version: 1.0
To: tor-talk@lists.torproject.org
References: <A6DD5B99-8E6D-4B21-AC82-14E92C8C6332@maclemon.at>
In-Reply-To: <A6DD5B99-8E6D-4B21-AC82-14E92C8C6332@maclemon.at>
Subject: Re: [tor-talk] Load Balancing/High Availability Hidden Services
X-BeenThere: tor-talk@lists.torproject.org
X-Mailman-Version: 2.1.15
Precedence: list
Reply-To: tor-talk@lists.torproject.org
List-Id: "all discussion about theory, design,
 and development of Onion Routing" <tor-talk.lists.torproject.org>
List-Unsubscribe: <https://lists.torproject.org/cgi-bin/mailman/options/tor-talk>, 
 <mailto:tor-talk-request@lists.torproject.org?subject=unsubscribe>
List-Archive: <http://lists.torproject.org/pipermail/tor-talk/>
List-Post: <mailto:tor-talk@lists.torproject.org>
List-Help: <mailto:tor-talk-request@lists.torproject.org?subject=help>
List-Subscribe: <https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-talk>, 
 <mailto:tor-talk-request@lists.torproject.org?subject=subscribe>
Content-Type: multipart/mixed; boundary="===============2409188783734146683=="
Errors-To: tor-talk-bounces@lists.torproject.org
Sender: "tor-talk" <tor-talk-bounces@lists.torproject.org>

This is an OpenPGP/MIME signed message (RFC 4880 and 3156)
--===============2409188783734146683==
Content-Type: multipart/signed; micalg=pgp-sha512;
 protocol="application/pgp-signature";
 boundary="xtVOBeoEcP4QM9qTD5p5DdFWB6hGa8Jvq"

This is an OpenPGP/MIME signed message (RFC 4880 and 3156)
--xtVOBeoEcP4QM9qTD5p5DdFWB6hGa8Jvq
Content-Type: text/plain; charset=windows-1252
Content-Transfer-Encoding: quoted-printable

On 11/03/15 15:27, MacLemon wrote:
> I'm looking into ideas for creating =93load balanced=94 or =93high avai=
lability=94 hidden services. Mostly pertaining to web servers serving lar=
ge-ish static files. (Let's say 5-100MB each.)
>=20
> Load balanced as in not all requests end up at the same box to speed up=
 downloads.
> High availability as in the service is still available if one box goes =
down or is taken offline for maintenance.
>=20
> So, not exactly your usual distributed-cluster setup.
>=20
>=20
> From what I understand it would not make sense to run the same HS Key o=
n multiple boxes since the descriptors would overwrite each other every f=
ew minutes.
>=20
> I don't think one can do something like Round-Robin DNS with HS.
>=20
> So the only way I can imagine this to work is a central redirection nod=
e that know about all the nodes and more or less intelligently/randomly 3=
02 redirects each file request to a known-to-it server.
>=20
> This still leaves a single-point-of-failure in form of the redirection =
server but would at least distribute the traffic load across multiple ser=
vers and cope for nodes coming and going.
>=20
> Has anyone done something like this?

Yes, I designed and implemented a modification to tor to do this.
Currently nothing I implemented is particularly usable, mostly due to
the nature of the modifications that I made, but also partly due to my
knowledge (or lack thereof) of the code base and c.

My report is available [1] (I did the work as an academic project), and
so is the branch in which I did the rough implementation [2].

There are also some threads on the tor-dev list where this is discussed.

1: http://cbaines.net/projects/tor/disths/report.pdf
2: http://git.cbaines.net/?p=3Dtor.git;a=3Dshortlog;h=3Drefs/heads/disths=



--xtVOBeoEcP4QM9qTD5p5DdFWB6hGa8Jvq
Content-Type: application/pgp-signature; name="signature.asc"
Content-Description: OpenPGP digital signature
Content-Disposition: attachment; filename="signature.asc"

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1

iQJ8BAEBCgBmBQJVAIAPXxSAAAAAAC4AKGlzc3Vlci1mcHJAbm90YXRpb25zLm9w
ZW5wZ3AuZmlmdGhob3JzZW1hbi5uZXQzRTg5RUVFNzQ1OEU3MjBEOTc1NEUwQjI1
RTI4QTMzQjBCODRGNTc3AAoJEF4oozsLhPV3lpoQAJVQlzNhWN+J7a88XQdPwBrC
rYYCKLfwxT8M/zTTvJnQoDMDK96ltKqqf7fvGQ6liQ/MJS/Mfz3MqsPgx91cHyGN
0xYVPNEOIBs+SZUiimwyna2OpBLHE1OdS+WnvUX+23eq1fojaniKKQwSGlcB46sI
CVBxvwMtcjxnCWb996dk8HJwRBFqT3jFQtkDNsdqyf0DpGdPhOdjYEQG9YfSdpjT
PP0RiEzhuvg2qyCyMUhxtDY36bnQyMPX1ds500A2C9BxIuEFIfb0wrAa0ofAs3id
wSPnqyX/N/JU+LnyrR/vq/Ptey5Z1GvQCSX7HvP2ZrE4D8W5M7udRlEikZuLLl1E
LUbFf+VK3SJYyJYzPhpTcZCusE4kxkHBLon6nWjz2D2CSEGDpZtah1Qq+JfGn3BZ
CEq37HXo5tlraJ6oqrsYuoRPmHjfg/iU2pjxKBZELeobpVK/QPsLqq/cBHPicNYT
poMM6i4X1iTRPlgMlEPalzfEopl2j2JG8Qq/pAIC4lXqPYwjzBvwTBQtTxwX3AIS
6o52RCo/n+dv82+AmpmQ8KveVk2HWRCC36w2ahkJ2vW2/gFFSWb/4LUL06A5SgFR
PlaAtzPSv9FwQ8lpc7mwcEZlSKWVzTVDOsCNNa9YkZ/vuIgN9hVpne0rzcg1UI2z
0yzlPczSgZgM8T3hU615
=rAzG
-----END PGP SIGNATURE-----

--xtVOBeoEcP4QM9qTD5p5DdFWB6hGa8Jvq--

--===============2409188783734146683==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

-- 
tor-talk mailing list - tor-talk@lists.torproject.org
To unsubscribe or change other settings go to
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-talk

--===============2409188783734146683==--

