Kieran Jacobsen | 23 Feb 2011 13:39

/build.sh error

Hi All,

I have a cobalt 2 running 5.1 RC4, which I am working on getting to 5.1 stable. I am using
http://netbsd.org/docs/updating.html as a guide.

Whilst SU-ed into ROOT and in /usr/src, I perform the commands:

./build.sh -O ../obj -T ../tools tools
 ./build.sh -O ../obj -T ../tools kernel=GENERIC

Which complete quickly and sucessfully

I am currently running the following command: ./build.sh -O ../obj -T ../tools -U distribution

After about 2 days this aborts the make distribution with the following error:

./stand/cobalt/5.1_STABLE/modules/umapfs/umapfs.kmod
./stand/cobalt/5.1_STABLE/modules/union
./stand/cobalt/5.1_STABLE/modules/union/union.kmod
./usr/share/man/cat4/btmagic.0
./usr/share/man/html4/btmagic.html
./usr/share/man/man4/btmagic.4
=========  end of 123 extra files  ===========

*** Failed target:  checkflist
*** Failed command: cd /usr/src/distrib/sets && DESTDIR=/usr/src/../obj/destdird
*** Error code 1

Stop.
nbmake: stopped in /usr/src/distrib/sets
(Continue reading)

Izumi Tsutsui | 24 Feb 2011 15:28
Picon
Gravatar

Re: /build.sh error

> =========  end of 123 extra files  ===========

Check timestamps of these extra files.

---
Izumi Tsutsui

Kieran Jacobsen | 24 Feb 2011 15:53

RE: /build.sh error

Ok...

bash-4.1# ls -lah /usr/src/../obj/destdir.cobalt/stand/cobalt/5.1_STABLE/modules/umapfs/umapfs.kmod
-r--r--r--  1 root  wheel   16K Feb 17 11:21 /usr/src/../obj/destdir.cobalt/stand/cobalt/5.1_STABLE/modules/umapfs/umapfs.kmod

Could this be a permissions issue?

-----Original Message-----
From: Izumi Tsutsui [mailto:tsutsui <at> ceres.dti.ne.jp] 
Sent: Friday, 25 February 2011 12:29 AM
To: Kieran Jacobsen
Cc: port-mips <at> NetBSD.org; tsutsui <at> ceres.dti.ne.jp
Subject: Re: /build.sh error

> =========  end of 123 extra files  ===========

Check timestamps of these extra files.

---
Izumi Tsutsui

Izumi Tsutsui | 24 Feb 2011 16:21
Picon
Gravatar

Re: /build.sh error

> bash-4.1# ls -lah /usr/src/../obj/destdir.cobalt/stand/cobalt/5.1_STABLE/modules/umapfs/umapfs.kmod
> -r--r--r--  1 root  wheel   16K Feb 17 11:21 /usr/src/../obj/destdir.cobalt/stand/cobalt/5.1_STABLE/modules/umapfs/umapfs.kmod

Hmm, if they are actualy built during the last build.sh, no problem.

> Could this be a permissions issue?

No, but it looks set list files under src/distrib/sets/lists are broken.
Check if they are taken from the correct branch. (see CVS/Entries)

% grep umapfs.kmod src/distrib/sets/lists/base/lkm.mi 
./ <at> MODULEDIR <at> /umapfs/umapfs.kmod                base-kernel-modules
% grep btmagic.0 src/distrib/sets/lists/man/mi
./usr/share/man/cat4/btmagic.0                  man-sys-catman          .cat
% 
---
Izumi Tsutsui

Kieran Jacobsen | 27 Feb 2011 10:59

RE: /build.sh error

-bash-4.1$ grep umapfs.kmod src/distrib/sets/lists/base/lkm.mi
grep: src/distrib/sets/lists/base/lkm.mi: No such file or directory

I am guessing the CVS sync didn't occur correctly then?

-----Original Message-----
From: Izumi Tsutsui [mailto:tsutsui <at> ceres.dti.ne.jp] 
Sent: Friday, 25 February 2011 1:22 AM
To: Kieran Jacobsen
Cc: port-mips <at> NetBSD.org; tsutsui <at> ceres.dti.ne.jp
Subject: Re: /build.sh error

> bash-4.1# ls -lah /usr/src/../obj/destdir.cobalt/stand/cobalt/5.1_STABLE/modules/umapfs/umapfs.kmod
> -r--r--r--  1 root  wheel   16K Feb 17 11:21 /usr/src/../obj/destdir.cobalt/stand/cobalt/5.1_STABLE/modules/umapfs/umapfs.kmod

Hmm, if they are actualy built during the last build.sh, no problem.

> Could this be a permissions issue?

No, but it looks set list files under src/distrib/sets/lists are broken.
Check if they are taken from the correct branch. (see CVS/Entries)

% grep umapfs.kmod src/distrib/sets/lists/base/lkm.mi 
./ <at> MODULEDIR <at> /umapfs/umapfs.kmod                base-kernel-modules
% grep btmagic.0 src/distrib/sets/lists/man/mi
./usr/share/man/cat4/btmagic.0                  man-sys-catman          .cat
% 
---
Izumi Tsutsui

(Continue reading)

Izumi Tsutsui | 4 Mar 2011 14:16
Picon
Gravatar

Re: /build.sh error

> I am guessing the CVS sync didn't occur correctly then?

No idea about cvs environment, but errors were caused by
inconsistent source tree.

---
Izumi Tsutsui

Kieran Jacobsen | 5 Mar 2011 01:05

RE: /build.sh error

Hmm, I might try hitting another mirror and will see what is happening.

-----Original Message-----
From: Izumi Tsutsui [mailto:tsutsui <at> ceres.dti.ne.jp] 
Sent: Friday, 4 March 2011 11:16 PM
To: Kieran Jacobsen
Cc: port-mips <at> NetBSD.org; tsutsui <at> ceres.dti.ne.jp
Subject: Re: /build.sh error

> I am guessing the CVS sync didn't occur correctly then?

No idea about cvs environment, but errors were caused by inconsistent source
tree.

---
Izumi Tsutsui

Attachment (smime.p7s): application/pkcs7-signature, 4915 bytes
Kieran Jacobsen | 5 Mar 2011 09:01

RE: /build.sh error

What are you using to maintain your source tree?

-----Original Message-----
From: Izumi Tsutsui <tsutsui <at> ceres.dti.ne.jp>
Sent: Friday, 4 March 2011 11:16 PM
To: Kieran Jacobsen <kieran <at> kjacobsen.net>
Cc: port-mips <at> NetBSD.org <port-mips <at> NetBSD.org>; tsutsui <at> ceres.dti.ne.jp <tsutsui <at> ceres.dti.ne.jp>
Subject: Re: /build.sh error

> I am guessing the CVS sync didn't occur correctly then?

No idea about cvs environment, but errors were caused by
inconsistent source tree.

---
Izumi Tsutsui

Izumi Tsutsui | 5 Mar 2011 12:12
Picon
Gravatar

Re: /build.sh error

> What are you using to maintain your source tree?

I think anoncvs.NetBSD.org is enough,
but source sets in daily build is easier
to fetch the latest netbsd-5 sources.

http://nyftp.NetBSD.org/pub/NetBSD-daily/netbsd-5/201103040500Z/source/sets/
http://releng.NetBSD.org/

---
Izumi Tsutsui

Kieran Jacobsen | 15 Mar 2011 10:57

RE: /build.sh error

Ok, downloaded the latest set of sources and extracted them to /usr/src. And now things look pretty much the
same after running the build.sh again.

./usr/share/man/man8/dnssec-dsfromkey.8
./usr/share/man/man8/dnssec-keyfromlabel.8
./usr/share/man/man8/dnssec-revoke.8
./usr/share/man/man8/dnssec-settime.8
=========  end of 203 extra files  ===========

*** Failed target:  checkflist
*** Failed command: cd /usr/src/distrib/sets && DESTDIR=/usr/src/../obj/destdir.cobalt
MACHINE=cobalt MACHINE_ARCH=mipsel AWK=/usr/src/../tools/bin/nbawk
CKSUM=/usr/src/../tools/bin/nbcksum DB=/usr/src/../tools/bin/nbdb HOST_SH=/bin/sh
MAKE=/usr/src/../tools/bin/nbmake MKTEMP=/usr/src/../tools/bin/nbmktemp
MTREE=/usr/src/../tools/bin/nbmtree PAX=/usr/src/../tools/bin/nbpax
SED=/usr/src/../tools/bin/nbsed TSORT=/usr/src/../tools/bin/nbtsort\ -q /bin/sh
/usr/src/distrib/sets/checkflist -M /usr/src/../obj/destdir.cobalt/METALOG.sanitised
*** Error code 1

Stop.
nbmake: stopped in /usr/src/distrib/sets

*** Failed target:  distribution
*** Failed command: _makedirtarget() { dir="$1"; shift; target="$1"; shift; case "${dir}" in /*)
this="${dir}/"; real="${dir}" ;; .) this=""; real="/usr/src" ;; *) this="${dir}/";
real="/usr/src/${dir}" ;; esac; show=${this:-.}; echo "${target} ===> ${show%/}${1:+ (with: $ <at> )}";
cd "${real}" && /usr/src/../tools/bin/nbmake _THISDIR_="${this}" "$ <at> " ${target}; };
_makedirtarget distrib/sets checkflist
*** Error code 1

(Continue reading)

Izumi Tsutsui | 15 Mar 2011 15:08
Picon
Gravatar

Re: /build.sh error

> Ok, downloaded the latest set of sources and extracted them to /usr/src.
> And now things look pretty much the same after running the build.sh again.
> 
> ./usr/share/man/man8/dnssec-dsfromkey.8
> ./usr/share/man/man8/dnssec-keyfromlabel.8
> ./usr/share/man/man8/dnssec-revoke.8
> ./usr/share/man/man8/dnssec-settime.8
> =========  end of 203 extra files  ===========

Well, different files so not same, but
does your host have any definitions in /etc/mk.conf or
shell environment values, like "MKfoo=no" or "NOfoo=" etc?
---
Izumi Tsutsui

Kieran Jacobsen | 15 Mar 2011 15:35

RE: /build.sh error

It is interesting that yes there are more files, I suspect it's the same from last + extras. Perhaps I didn't
clean up enough after the failed build based off CVS?

cat /etc/mk.conf

WRKOBJDIR=/usr/work
DISTDIR=/usr/distfiles
PKG_RCD_SCRIPTS=YES

Env print out

TERM=xterm
SHELL=/bin/csh
SSH_CLIENT=172.16.0.100 21909 22
SSH_TTY=/dev/ttyp0
USER=<removed>
ENV=/home/≤removed>/.shrc
PAGER=more
MAIL=/var/mail/≤removed>
PATH=/sbin:/usr/sbin:/bin:/usr/bin:/usr/pkg/sbin:/usr/pkg/bin:/usr/X11R7/bin:/usr/X11R6/bin:/usr/local/sbin:/usr/local/bin
EXINIT=set autoindent
PWD=/home/≤removed>
EDITOR=vi
SHLVL=1
HOME=/root
LOGNAME=<removed>
SSH_CONNECTION=<removed>
_=/usr/bin/su
SU_FROM=<removed>
BLOCKSIZE=1k
(Continue reading)

Izumi Tsutsui | 16 Mar 2011 14:40
Picon
Gravatar

Re: /build.sh error

> It is interesting that yes there are more files,
> I suspect it's the same from last + extras.
> Perhaps I didn't clean up enough after the failed build based off CVS?

It's better to remove all files under DESTDIR before build,
and also all files under /usr/src before extracting new sets.
---
Izumi Tsutsui

Kieran Jacobsen | 6 Apr 2011 00:50

RE: /build.sh error

Just thought I should let you all know, I removed all files in DESTDIR, reran build.sh and everything worked.

-----Original Message-----
From: Izumi Tsutsui [mailto:tsutsui <at> ceres.dti.ne.jp]
Sent: Wednesday, 16 March 2011 11:41 PM
To: Kieran Jacobsen
Cc: port-mips <at> NetBSD.org; tsutsui <at> ceres.dti.ne.jp
Subject: Re: /build.sh error

> It is interesting that yes there are more files, I suspect it's the
> same from last + extras.
> Perhaps I didn't clean up enough after the failed build based off CVS?

It's better to remove all files under DESTDIR before build, and also all files under /usr/src before
extracting new sets.
---
Izumi Tsutsui


Gmane