I want to create a local copy of the Gentoo source package repository,
but the computer that will be using to mirror the repository is running
Debian, not Gentoo.

How do I make the mirror?

My next question will be how to I configure the system to serve the
respository contents to Gentoo clients?

Thanks in advance to anyone who can help.

Mark.

--
Mark Hobley,
393 Quinton Road West,
Quinton, BIRMINGHAM.
B32 1QE.

Mark Hobley wrote:

> I want to create a local copy of the Gentoo source package repository,
> but the computer that will be using to mirror the repository is running
> Debian, not Gentoo.
>
> How do I make the mirror?
>
> My next question will be how to I configure the system to serve the
> respository contents to Gentoo clients?

You have several options here. Generally, you don't need to mirror the whole
source repository, unless you intend to serve as a public source mirror
(see below).

An option is to set up a nfs share and have all the clients mount that share
under /usr/portage/distfiles (or even /usr/portage), so tarballs downloaded
by one client can be reused by other clients. This is the HOWTO:

http://gentoo-wiki.com/HOWTO_Using_a...ortage_via_NFS

Another option is to use a HTTP cache like http-replicator:

http://forums.gentoo.org/viewtopic.php?p=1138287

Or torpage:

http://www.kroon.co.za/torpage.php

See also this gentoo-user threads:

http://marc.info/?l=gentoo-user&m=117005999007804&w=2
http://marc.info/?l=gentoo-user&m=114991049622866&w=2

If you still want to setup a source mirror, this document explains how to
mirror the gentoo source repository:

http://www.gentoo.org/doc/en/source_mirrors.xml


As a side note, you may also want to setup your own rsync server for the
clients. Probably the following document is helpful:

http://www.gentoo.org/doc/en/rsync.xml
http://gentoo-wiki.com/HOWTO_Local_Rsync_Mirror

As you can see, running gentoo on the rsync server or source repository is
not required.

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

On Saturday 02 Feb 2008 11:08 in article
<ohud75-p5v.ln1@neptune.markhobley.yi.org> of alt.os.linux.gentoo, Mark
Hobley(markhobley@hotpop.donottypethisbit.com) wrote:

> I want to create a local copy of the Gentoo source package repository,

I take it you mean /usr/portage/distfiles.

> but the computer that will be using to mirror the repository is
> running Debian, not Gentoo.
>
> How do I make the mirror?
>
> My next question will be how to I configure the system to serve the
> respository contents to Gentoo clients?

These are basically the same question.

Create a suitable directory on your Debian box and add it to your
NFS "exports" file, typically /etc/exports. The format of this file is
quite simple and documented in man 5 exports.

You then need to start your NFS daemon on the Debian box.

On your Gentoo box add an entry to /etc/fstab so
that /usr/portage/distfiles is mounted using the NFS filesystem and the
IP or DNS address of your Debian box. See man 5 nfs.
- --
Regards

Dave [RLU#314465]
================================================== ====
dwnoon@spamtrap.ntlworld.com (David W Noon)
Remove spam trap to reply via e-mail.
================================================== ====

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.7 (GNU/Linux)

iD8DBQFHpF829MqaUJQw2MkRAvo7AJwJkWKEfJIHqZy9KMz4K4 KdWVQz9ACfRhir
uBnEiWk5o6ZrailUUYTd7M0=
=eRdo
-----END PGP SIGNATURE-----

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

On Saturday 02 Feb 2008 11:08 in article
<ohud75-p5v.ln1@neptune.markhobley.yi.org> of alt.os.linux.gentoo, Mark
Hobley(markhobley@hotpop.donottypethisbit.com) wrote:

> I want to create a local copy of the Gentoo source package repository,

I take it you mean /usr/portage/distfiles.

> but the computer that will be using to mirror the repository is
> running Debian, not Gentoo.
>
> How do I make the mirror?
>
> My next question will be how to I configure the system to serve the
> respository contents to Gentoo clients?

These are basically the same question.

Create a suitable directory on your Debian box and add it to your
NFS "exports" file, typically /etc/exports. The format of this file is
quite simple and documented in man 5 exports.

You then need to start your NFS daemon on the Debian box.

On your Gentoo box add an entry to /etc/fstab so
that /usr/portage/distfiles is mounted using the NFS filesystem and the
IP or DNS address of your Debian box. See man 5 nfs.
- --
Regards

Dave [RLU#314465]
================================================== ====
dwnoon@spamtrap.ntlworld.com (David W Noon)
Remove spam trap to reply via e-mail.
================================================== ====

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.7 (GNU/Linux)

iD8DBQFHpF829MqaUJQw2MkRAvo7AJwJkWKEfJIHqZy9KMz4K4 KdWVQz9ACfRhir
uBnEiWk5o6ZrailUUYTd7M0=
=eRdo
-----END PGP SIGNATURE-----

pk <pk@pk.pk> wrote:

> You have several options here. Generally, you don't need to mirror the whole
> source repository, unless you intend to serve as a public source mirror
> (see below).

Ok, what I basically want is the source code to all of the packages, so
that I can edit the files locally to produce modified versions.

> As a side note, you may also want to setup your own rsync server for the
> clients. Probably the following document is helpful:

I plan to do this.

At the moment, the clients use:

SYNC="rsync://rsync.europe.gentoo.org/gentoo-portage/"
GENTOO_MIRRORS="ftp://gentoo.virginmedia.com/sites/gentoo/"

The Virgin mirror does not provide an rsync facility, so I will use
rsync.de.gentoo.org to populate my mirror.

> this document explains how to mirror the gentoo source repository:
> http://www.gentoo.org/doc/en/source_mirrors.xml

That website doesn't actually give the rsync command to use.

I want to mirror just /distfiles

I have created two directories:

/volumes/vol3a/gentoo
/volumes/vol3a/gentoo-portage

I now try to populate the gentoo directory:

rsync -avz rsync.de.gentoo.org/gentoo/distfiles /volumes/vol3a/gentoo
building file list ... rsync: link_stat
"/volumes/vol3a/gentoo/rsync.de.gentoo.org/gentoo/distfiles" failed: No
such file or directory (2)

I want the rsync to automatically create the directory structure as
required, and I want distfiles to go straight into
/volumes/vol3a/gentoo/distfiles (I don't want the
.../rsync.de.gentoo.org/.. subdirectory structure).

How can I do this?

Regards,

Mark.

--
Mark Hobley,
393 Quinton Road West,
Quinton, BIRMINGHAM.
B32 1QE.

pk <pk@pk.pk> wrote:

> You have several options here. Generally, you don't need to mirror the whole
> source repository, unless you intend to serve as a public source mirror
> (see below).

Ok, what I basically want is the source code to all of the packages, so
that I can edit the files locally to produce modified versions.

> As a side note, you may also want to setup your own rsync server for the
> clients. Probably the following document is helpful:

I plan to do this.

At the moment, the clients use:

SYNC="rsync://rsync.europe.gentoo.org/gentoo-portage/"
GENTOO_MIRRORS="ftp://gentoo.virginmedia.com/sites/gentoo/"

The Virgin mirror does not provide an rsync facility, so I will use
rsync.de.gentoo.org to populate my mirror.

> this document explains how to mirror the gentoo source repository:
> http://www.gentoo.org/doc/en/source_mirrors.xml

That website doesn't actually give the rsync command to use.

I want to mirror just /distfiles

I have created two directories:

/volumes/vol3a/gentoo
/volumes/vol3a/gentoo-portage

I now try to populate the gentoo directory:

rsync -avz rsync.de.gentoo.org/gentoo/distfiles /volumes/vol3a/gentoo
building file list ... rsync: link_stat
"/volumes/vol3a/gentoo/rsync.de.gentoo.org/gentoo/distfiles" failed: No
such file or directory (2)

I want the rsync to automatically create the directory structure as
required, and I want distfiles to go straight into
/volumes/vol3a/gentoo/distfiles (I don't want the
.../rsync.de.gentoo.org/.. subdirectory structure).

How can I do this?

Regards,

Mark.

--
Mark Hobley,
393 Quinton Road West,
Quinton, BIRMINGHAM.
B32 1QE.

Mark Hobley wrote:

>> this document explains how to mirror the gentoo source repository:
>> http://www.gentoo.org/doc/en/source_mirrors.xml
>
> That website doesn't actually give the rsync command to use.

That document is for setting up a *public* source mirror. And it tells you
that you have to sync with ftp.ussg.iu.edu::gentoo-distfiles, not with just
any mirror.

If you just want to have the sources for the packages, remember that you can
get *any* source package just by using emerge -f, without the need to set
up a full source mirror.

Also remember that if you modify the sources in any way you cannot install
them using emerge unless you regenerate the ebuild and digests for the
packages first. Read the developer handbook for more info.

Mark Hobley wrote:

>> this document explains how to mirror the gentoo source repository:
>> http://www.gentoo.org/doc/en/source_mirrors.xml
>
> That website doesn't actually give the rsync command to use.

That document is for setting up a *public* source mirror. And it tells you
that you have to sync with ftp.ussg.iu.edu::gentoo-distfiles, not with just
any mirror.

If you just want to have the sources for the packages, remember that you can
get *any* source package just by using emerge -f, without the need to set
up a full source mirror.

Also remember that if you modify the sources in any way you cannot install
them using emerge unless you regenerate the ebuild and digests for the
packages first. Read the developer handbook for more info.

pk <pk@pk.pk> wrote:

> That document is for setting up a *public* source mirror. And it tells you
> that you have to sync with ftp.ussg.iu.edu::gentoo-distfiles, not with just
> any mirror.

Yeah. I only want a local mirror, and I am happy to mirror from the
european repository. I'm only after the packages

> Also remember that if you modify the sources in any way you cannot install
> them using emerge unless you regenerate the ebuild and digests for the
> packages first. Read the developer handbook for more info.

Ok. I'll have a look at that.

I really want to know why my rsync command is failing and how to shorten
the download pathname to /volumes/vol3a/gentoo/distfiles

rsync -avz rsync.de.gentoo.org/gentoo/distfiles /volumes/vol3a/gentoo
building file list ... rsync: link_stat
"/volumes/vol3a/gentoo/rsync.de.gentoo.org/gentoo/distfiles" failed: No
such file or directory (2)

Regards,

Mark.

--
Mark Hobley,
393 Quinton Road West,
Quinton, BIRMINGHAM.
B32 1QE.

pk <pk@pk.pk> wrote:

> That document is for setting up a *public* source mirror. And it tells you
> that you have to sync with ftp.ussg.iu.edu::gentoo-distfiles, not with just
> any mirror.

Yeah. I only want a local mirror, and I am happy to mirror from the
european repository. I'm only after the packages

> Also remember that if you modify the sources in any way you cannot install
> them using emerge unless you regenerate the ebuild and digests for the
> packages first. Read the developer handbook for more info.

Ok. I'll have a look at that.

I really want to know why my rsync command is failing and how to shorten
the download pathname to /volumes/vol3a/gentoo/distfiles

rsync -avz rsync.de.gentoo.org/gentoo/distfiles /volumes/vol3a/gentoo
building file list ... rsync: link_stat
"/volumes/vol3a/gentoo/rsync.de.gentoo.org/gentoo/distfiles" failed: No
such file or directory (2)

Regards,

Mark.

--
Mark Hobley,
393 Quinton Road West,
Quinton, BIRMINGHAM.
B32 1QE.