How to gitian build dash under Debian Jessie using lxc

mraksel · Jul 15, 2015

i use system debian-8.1.0-amd64 run on VMware, host windows.
i make gitian user on instaliation. Make port forward VMware host 22222 to 22 on guest end connect to debian with putty on ssh.
Now i make clean install , on install i choice only ssh end standart system utilites.
Run su on terminal end login as root.
Make standart apt-get update/upgrade.
Put on terminal.

Code:

apt-get install git ruby sudo apt-cacher-ng qemu-utils debootstrap lxc python-cheetah parted kpartx bridge-utils

end its run success all install normal.
after i make gtitian sudores user with

Code:

adduser gitian sudo

end its success

then i make this

Code:

root@gitian:~# echo "cgroup /sys/fs/cgroup cgroup defaults 0 0" >> /etc/fstab
root@gitian:~# echo '#!/bin/sh -e' > /etc/rc.local
root@gitian:~# echo 'brctl addbr br0' >> /etc/rc.local
root@gitian:~# echo 'ifconfig br0 10.0.3.2/24 up' >> /etc/rc.local
root@gitian:~# echo 'exit 0' >> /etc/rc.local
root@gitian:~# echo 'export USE_LXC=1' >> /home/gitian/.profile
root@gitian:~# echo 'export GITIAN_HOST_IP=10.0.3.2' >> /home/gitian/.profile
root@gitian:~# echo 'export LXC_GUEST_IP=10.0.3.5' >> /home/gitian/.profile
root@gitian:~#

end reboot
lxc-checkconfig

Code:

gitian@gitian:~/gitian-builder$ lxc-checkconfig
Kernel configuration not found at /proc/config.gz; searching...
Kernel configuration found at /boot/config-3.16.0-4-amd64
--- Namespaces ---
Namespaces: enabled
Utsname namespace: enabled
Ipc namespace: enabled
Pid namespace: enabled
User namespace: enabled
Network namespace: enabled
Multiple /dev/pts instances: enabled
--- Control groups ---
Cgroup: enabled
Cgroup clone_children flag: enabled
Cgroup device: enabled
Cgroup sched: enabled
Cgroup cpu account: enabled
Cgroup memory controller: enabled
Cgroup cpuset: enabled
--- Misc ---
Veth pair device: enabled
Macvlan: enabled
Vlan: enabled
File capabilities: enabled
Note : Before booting a new kernel, you can check its configuration
usage : CONFIG=/path/to/config /usr/bin/lxc-checkconfig

mraksel · Jul 15, 2015

after i make cd .. end start next step

Code:

gitian@gitian:~$ git clone xxx//githubcom/devrandom/gitian-builder.git
Cloning into 'gitian-builder'...
remote: Counting objects: 753, done.
remote: Total 753 (delta 0), reused 0 (delta 0), pack-reused 753
Receiving objects: 100% (753/753), 160.06 KiB | 0 bytes/s, done.
Resolving deltas: 100% (385/385), done.
Checking connectivity... done.

Code:

gitian@gitian:~$ git clone xxxx//githubcom/devrandom/gitian-builder.git
Cloning into 'gitian-builder'...
remote: Counting objects: 753, done.
remote: Total 753 (delta 0), reused 0 (delta 0), pack-reused 753
Receiving objects: 100% (753/753), 160.06 KiB | 0 bytes/s, done.
Resolving deltas: 100% (385/385), done.
Checking connectivity... done.
gitian@gitian:~$ git clone xxx//githubcom/dashpay/dash
Cloning into 'dash'...
remote: Counting objects: 70674, done.
remote: Compressing objects: 100% (8/8), done.
remote: Total 70674 (delta 0), reused 0 (delta 0), pack-reused 70666
Receiving objects: 100% (70674/70674), 82.35 MiB | 493.00 KiB/s, done.
Resolving deltas: 100% (50463/50463), done.
Checking connectivity... done.
gitian@gitian:~$

then i edit this /home/gitian/gitian-builder/bin/make-base-vm

mraksel · Jul 15, 2015

put sudo on mkfs.ext4 -F $OUT-lxc

Code:

if [ $LXC = "1" ]; then
  if [ -e $OUT ]; then
  echo $OUT already exists, please remove it first
  exit 1
  fi
  sudo rm -rf $OUT-bootstrap
  # Need universe for lxc in lucid
  env -i LANG=en_US.UTF-8 LC_ALL=en_US.UTF-8 sudo debootstrap --arch=$ARCH --include=$addpkg --exclude=$removepkg --components=main,universe $SUITE $OUT-bootstrap $MIRROR
  dd if=/dev/zero of=$OUT-lxc bs=1M count=1 seek=10240
  sudo mkfs.ext4 -F $OUT-lxc
  t=`mktemp -d gitian.XXXXXXXX`
  sudo mount $OUT-lxc $t
  sudo cp -a $OUT-bootstrap/* $t
  sudo umount $t
  rmdir $t

after i make this

Code:

cd gitian-builder
bin/make-base-vm --lxc --arch amd64 --suite precise

output

Code:

[code]
gitian@gitian:~$ cd gitian-builder
gitian@gitian:~/gitian-builder$ bin/make-base-vm --lxc --arch amd64 --suite precise
Generating public/private dsa key pair.
Your identification has been saved in var/id_dsa.
Your public key has been saved in var/id_dsa.pub.
The key fingerprint is:
99:bd:0f:8e:2e:6f:d6:94:15:11:1a:76:82:78:31:0e gitian@gitian
The key's randomart image is:
+---[DSA 1024]----+
|  E.oo+ +o  |
|  .ooo =.  |
|  .. .  .  |
|  +  .  |
|  S .o  |
|  o.  |
|  oo  |
|  . oo.o  |
|  *+ . .  |
+-----------------+
W: Cannot check Release signature; keyring file not available /usr/share/keyrings/ubuntu-archive-keyring.gpg
I: Retrieving Release
I: Retrieving Packages
I: Validating Packages
I: Retrieving Packages
I: Validating Packages
I: Resolving dependencies of required packages...
I: Resolving dependencies of base packages...
I: Found additional base dependencies: binutils bridge-utils ca-certificates cpp cpp-4.6 cron dnsmasq-base dpkg-dev g++ g++-4.6 gcc gcc-4.6 git git-man iptables language-pack-en-base libapparmor1 libapr1 libaprutil1 libasn1-8-heimdal libc6-dev libcap2 libc-dev-bin libclass-isa-perl libcurl3-gnutls libdb4.8 libdpkg-perl liberror-perl libgcrypt11 libgdbm3 libgmp10 libgnutls26 libgomp1 libgpg-error0 libgssapi3-heimdal libgssapi-krb5-2 libhcrypto4-heimdal libheimbase1-heimdal libheimntlm0-heimdal libhx509-5-heimdal libidn11 libk5crypto3 libkeyutils1 libkrb5-26-heimdal libkrb5-3 libkrb5support0 libldap-2.4-2 libmpc2 libmpfr4 libneon27-gnutls libnetfilter-conntrack3 libnfnetlink0 libp11-kit0 libpci3 libquadmath0 libroken18-heimdal librtmp0 libsasl2-2 libstdc++6-4.6-dev libsvn1 libswitch-perl libtasn1-3 libtimedate-perl libwind0-heimdal libxml2 linux-libc-dev make openssl patch perl perl-modules rsync
I: Checking component main on 
I: Checking component universe on

end of this

Code:

I: Base system installed successfully.
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.00279528 s, 375 MB/s
mke2fs 1.42.12 (29-Aug-2014)
Discarding device blocks: done
Creating filesystem with 2621440 4k blocks and 656640 inodes
Filesystem UUID: 265424a5-6979-4ae5-ac8e-4d0b5788f192
Superblock backups stored on blocks:
  32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632
Allocating group tables: done
Writing inode tables: done
Creating journal (32768 blocks): done
Writing superblocks and filesystem accounting information: done

mraksel · Jul 15, 2015

then i do this

Code:

cd ~gitian/dash
git pull
cd ~gitian/gitian-builder
make -C ../dash/depends download SOURCES_PATH=`pwd`/cache/common

output's

Code:

gitian@gitian:~/gitian-builder$ cd ~gitian/dash
gitian@gitian:~/dash$ git pull
Already up-to-date.
gitian@gitian:~/dash$

Code:

gitian@gitian:~/gitian-builder$ cd ~gitian/dash
gitian@gitian:~/dash$ git pull
Already up-to-date.
gitian@gitian:~/dash$ cd ~gitian/gitian-builder
gitian@gitian:~/gitian-builder$ cd
gitian@gitian:~$ apt-get install make automake
E: Could not open lock file /var/lib/dpkg/lock - open (13: Permission denied)
E: Unable to lock the administration directory (/var/lib/dpkg/), are you root?
gitian@gitian:~$ su
Password:
root@gitian:/home/gitian# cd
root@gitian:~# apt-get install make automake
Reading package lists... Done
Building dependency tree
Reading state information... Done
The following extra packages will be installed:
  autoconf autotools-dev
Suggested packages:
  autoconf-archive gnu-standards autoconf-doc libtool gettext make-doc
The following NEW packages will be installed:
  autoconf automake autotools-dev make
0 upgraded, 4 newly installed, 0 to remove and 0 not upgraded.
Need to get 0 B/1,485 kB of archives.
After this operation, 5,142 kB of additional disk space will be used.
Do you want to continue? [Y/n]
Selecting previously unselected package autoconf.
(Reading database ... 33588 files and directories currently installed.)
Preparing to unpack .../autoconf_2.69-8_all.deb ...
Unpacking autoconf (2.69-8) ...
Selecting previously unselected package autotools-dev.
Preparing to unpack .../autotools-dev_20140911.1_all.deb ...
Unpacking autotools-dev (20140911.1) ...
Selecting previously unselected package automake.
Preparing to unpack .../automake_1.14.1-4_all.deb ...
Unpacking automake (1:1.14.1-4) ...
Selecting previously unselected package make.
Preparing to unpack .../make_4.0-8.1_amd64.deb ...
Unpacking make (4.0-8.1) ...
Processing triggers for man-db (2.7.0.2-5) ...
Processing triggers for install-info (5.2.0.dfsg.1-6) ...
Setting up autoconf (2.69-8) ...
Setting up autotools-dev (20140911.1) ...
Setting up automake (1:1.14.1-4) ...
update-alternatives: using /usr/bin/automake-1.14 to provide /usr/bin/automake (automake) in auto mode
Setting up make (4.0-8.1) ...
root@gitian:~# cd ~gitian/gitian-builder
root@gitian:/home/gitian/gitian-builder# make -C ../dash/depends download SOURCES_PATH=`pwd`/cache/common
make: Entering directory '/home/gitian/dash/depends'
make[1]: Entering directory '/home/gitian/dash/depends'
Fetching boost...
[/spoiler]

end of this

Code:

make[1]: Leaving directory '/home/gitian/dash/depends'
make[1]: Entering directory '/home/gitian/dash/depends'
make[1]: Leaving directory '/home/gitian/dash/depends'
make: Leaving directory '/home/gitian/dash/depends'
root@gitian:/home/gitian/gitian-builder#

after i try run this

Code:

./bin/gbuild --commit dash ../dash/contrib/gitian-descriptors/gitian-win.yml

output error :sad:

Code:

root@gitian:/home/gitian/gitian-builder# ./bin/gbuild --commit dash ../dash/contrib/gitian-descriptors/gitian-win.yml
sh: 1: cd: can't cd to inputs
sh: 1: cd: can't cd to inputs
sh: 1: cd: can't cd to inputs
sh: 1: cd: can't cd to inputs
sh: 1: cd: can't cd to inputs
sh: 1: cd: can't cd to inputs
sh: 1: cd: can't cd to inputs
sh: 1: cd: can't cd to inputs
./bin/gbuild:238:in `block in <main>': must specify a commit for directory dash (RuntimeError)
  from ./bin/gbuild:235:in `each'
  from ./bin/gbuild:235:in `<main>'
root@gitian:/home/gitian/gitian-builder#

Code:

mraksel · Jul 15, 2015

Code:

root@gitian:/home/gitian/gitian-builder# ./bin/gbuild --commit dash=v0.12.0.x ../dash/contrib/gitian-descriptors/gitian-win.yml
sh: 1: cd: can't cd to inputs
sh: 1: cd: can't cd to inputs
sh: 1: cd: can't cd to inputs
sh: 1: cd: can't cd to inputs
sh: 1: cd: can't cd to inputs
sh: 1: cd: can't cd to inputs
sh: 1: cd: can't cd to inputs
sh: 1: cd: can't cd to inputs
Initialized empty Git repository in /home/gitian/gitian-builder/inputs/dash/.git/
remote: Counting objects: 70685, done.
remote: Compressing objects: 100% (19/19), done.
remote: Total 70685 (delta 7), reused 0 (delta 0), pack-reused 70666
Receiving objects: 100% (70685/70685), 82.36 MiB | 497.00 KiB/s, done.
Resolving deltas: 100% (50470/50470), done.
From https://githubcom/dashpay/dash
* [new tag]  0.8.3.7-cc -> 0.8.3.7-cc
* [new tag]  v0.1.5  -> v0.1.5
* [new tag]  v0.1.6test1 -> v0.1.6test1
then be long text ...

* [new tag]  v0.9.5.5  -> v0.9.5.5
* [new branch]  consensus-voting-sysstem -> consensus-voting-sysstem
* [new branch]  master  -> master
* [new branch]  master-v0.10 -> master-v0.10
* [new branch]  revert-414-v0.12.0.x_fix_minmnpaymentsproto -> revert-414-v0.12.0.x_fix_minmnpaymentsproto
* [new branch]  v0.11.1.x  -> v0.11.1.x
* [new branch]  v0.11.2.x  -> v0.11.2.x
* [new branch]  v0.12.0.x  -> v0.12.0.x
--- Building for precise amd64 ---
Stopping target if it is up
Making a new image copy
lxc-execute: failed to open log file "/var/lib/lxc/gitian/gitian.log" : No such file or directory
sudo: unable to resolve host gitian
stdin: is not a tty
Reading package lists... Done
Building dependency tree... Done
The following packages will be REMOVED:
  rsyslog ubuntu-minimal
0 upgraded, 0 newly installed, 2 to remove and 0 not upgraded.
After this operation, 1289 kB disk space will be freed.
(Reading database ... 16065 files and directories currently installed.)
Removing ubuntu-minimal ...
Removing rsyslog ...
initctl: Unable to connect to Upstart: Failed to connect to socket /com/ubuntu/upstart: Connection refused
Processing triggers for ureadahead ...
Adding 'local diversion of /sbin/initctl to /sbin/initctl.distrib'
Adding 'local diversion of /usr/bin/ischroot to /usr/bin/ischroot.distrib'
Adding 'local diversion of /usr/sbin/policy-rc.d to /usr/sbin/policy-rc.d.distrib'
Starting target
Checking if target is up
Preparing build environment
tar: qt-win32-5.2.0-gitian-r3.zip: Cannot stat: No such file or directory
tar: Exiting with failure status due to previous errors
tar: qt-win64-5.2.0-gitian-r3.zip: Cannot stat: No such file or directory
tar: Exiting with failure status due to previous errors
tar: boost-win32-1.55.0-gitian-r6.zip: Cannot stat: No such file or directory
tar: Exiting with failure status due to previous errors
tar: boost-win64-1.55.0-gitian-r6.zip: Cannot stat: No such file or directory
tar: Exiting with failure status due to previous errors
tar: bitcoin-deps-win32-gitian-r16.zip: Cannot stat: No such file or directory
tar: Exiting with failure status due to previous errors
tar: bitcoin-deps-win64-gitian-r16.zip: Cannot stat: No such file or directory
tar: Exiting with failure status due to previous errors
tar: protobuf-win32-2.5.0-gitian-r4.zip: Cannot stat: No such file or directory
tar: Exiting with failure status due to previous errors
tar: protobuf-win64-2.5.0-gitian-r4.zip: Cannot stat: No such file or directory
tar: Exiting with failure status due to previous errors
Updating apt-get repository (log in var/install.log)
Installing additional packages (log in var/install.log)
Upgrading system, may take a while
Creating package manifest
stdin: is not a tty
Creating build script (var/build-script)
Running build script (log in var/build.log)
./bin/gbuild:21:in `system!': failed to run on-target setarch x86_64 bash -x < var/build-script > var/build.log 2>&1 (RuntimeError)
  from ./bin/gbuild:137:in `build_one_configuration'
  from ./bin/gbuild:264:in `block (2 levels) in <main>'
  from ./bin/gbuild:259:in `each'
  from ./bin/gbuild:259:in `block in <main>'
  from ./bin/gbuild:257:in `each'
  from ./bin/gbuild:257:in `<main>'
root@gitian:/home/gitian/gitian-builder#

mraksel · Jul 15, 2015

install.log

Code:

stdin: is not a tty

build.log

Code:

+ set -e
+ export LANG=en_US.UTF-8
+ LANG=en_US.UTF-8
+ export LC_ALL=en_US.UTF-8
+ LC_ALL=en_US.UTF-8
+ umask 002
+ export OUTDIR=/home/ubuntu/out
+ OUTDIR=/home/ubuntu/out
+ GBUILD_BITS=64
+ MAKEOPTS=(-j2)
+ REFERENCE_DATETIME='2014-01-10 00:00:00'
+ REFERENCE_DATE=2014-01-10
+ REFERENCE_TIME=00:00:00
+ cd build/dash
+ git reset -q --hard
+ git clean -q -f -d
+ cd build
+ export TZ=UTC
+ TZ=UTC
+ INDIR=/home/ubuntu/build
+ OPTFLAGS=-O2
+ TEMPDIR=/home/ubuntu/tempdir
+ NEEDDIST=1
+ export QT_RCC_TEST=1
+ QT_RCC_TEST=1
+ for BITS in 32 64
+ STAGING=/home/ubuntu/staging32
+ BUILDDIR=/home/ubuntu/build32
+ BINDIR=/home/ubuntu/out/32
+ '[' 32 == 32 ']'
+ HOST=i686-w64-mingw32
+ export PATH=/home/ubuntu/staging32/host/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
+ PATH=/home/ubuntu/staging32/host/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
+ mkdir -p /home/ubuntu/staging32 /home/ubuntu/build32 /home/ubuntu/out/32
+ cd /home/ubuntu/staging32
+ unzip /home/ubuntu/build/qt-win32-5.2.0-gitian-r3.zip
unzip:  cannot find or open /home/ubuntu/build/qt-win32-5.2.0-gitian-r3.zip, /home/ubuntu/build/qt-win32-5.2.0-gitian-r3.zip.zip or /home/ubuntu/build/qt-win32-5.2.0-gitian-r3.zip.ZIP.

crowning · Jul 15, 2015

mraksel said:
..
Preparing build environment
tar: qt-win32-5.2.0-gitian-r3.zip: Cannot stat: No such file or directory
tar: Exiting with failure status due to previous errors
...

In the documentation I've linked to (https://github.com/dashpay/dash/blob/master/doc/gitian-building.md) you forgot a step in the chapter "Getting and building the inputs....there's a link doc/release-process.md where you have to follow the 'Fetch and build inputs' instructions.

Edit: The "make -C ../dash/depends" command you've used only works with v0.12.0.x, whereas doc/release-process.md is for the current Dash-version. You have to decide which version you want to build and follow EXACTLY this instructions:

Current version: https://github.com/dashpay/dash/blob/master/doc/gitian-building.md
v0.12.0.x (currently in testing phase): https://github.com/dashpay/dash/blob/v0.12.0.x/doc/gitian-building.md

You can NOT mix both.

mraksel · Jul 15, 2015

where get this ?
export SIGNER=(your gitian key, ie bluematt, sipa, etc)

mraksel · Jul 15, 2015

i dont understand how to build inputs ,where in this instruction's how to build them ? i see only gow down load them but not se how to build end linked, where find the gitian key

mraksel · Jul 15, 2015

how fix this ?
gitian@gitian:~/gitian-builder/inputs$ sudo wget svnboostorg/trac/boost/raw-attachment/ticket/7262/boost-mingw.patch' -O \
> boost-mingw-gas-cross-compile-2013-03-03.patch
--2015-07-15 06:53:58-- svnboostorg/trac/boost/raw-attachment/ticket/7262/boost-mingw.patch
Resolving svnboostorg (svnboostorg)... 129.79.39.203
Connecting to svnboostorg (svnboostorg)|129.79.39.203|:443... connected.
ERROR: The certificate of ‘svnboostorg’ is not trusted.
ERROR: The certificate of ‘svnboostorg’ has expired.
The certificate has expired

flare · Jul 15, 2015

mraksel said:
where get this ?
export SIGNER=(your gitian key, ie bluematt, sipa, etc)

You don't need that for building, just for releasing software.

mraksel said:
i dont understand how to build inputs ,where in this instruction's how to build them ? i see only gow down load them but not se how to build end linked, where find the gitian key

This instructions are here

https://github.com/dashpay/dash/blob/master/doc/release-process.md

Fetch and build inputs: (first time, or when dependency versions change)

Code:

wget 'http://miniupnp.free.fr/files/download.php?file=miniupnpc-1.9.20140701.tar.gz' -O miniupnpc-1.9.20140701.tar.gz
wget 'https://www.openssl.org/source/openssl-1.0.1k.tar.gz'
wget 'http://download.oracle.com/berkeley-db/db-4.8.30.NC.tar.gz'
wget 'http://zlib.net/zlib-1.2.8.tar.gz'
wget 'ftp://ftp.simplesystems.org/pub/png/src/history/libpng16/libpng-1.6.8.tar.gz'
wget 'https://fukuchi.org/works/qrencode/qrencode-3.4.3.tar.bz2'
wget 'https://downloads.sourceforge.net/project/boost/boost/1.55.0/boost_1_55_0.tar.bz2'
wget 'https://svn.boost.org/trac/boost/raw-attachment/ticket/7262/boost-mingw.patch' -O \
     boost-mingw-gas-cross-compile-2013-03-03.patch
wget 'https://download.qt-project.org/official_releases/qt/5.2/5.2.0/single/qt-everywhere-opensource-src-5.2.0.tar.gz'
wget 'https://download.qt-project.org/archive/qt/4.6/qt-everywhere-opensource-src-4.6.4.tar.gz'
wget 'https://protobuf.googlecode.com/files/protobuf-2.5.0.tar.bz2'
wget 'https://github.com/mingwandroid/toolchain4/archive/10cc648683617cca8bcbeae507888099b41b530c.tar.gz'
wget 'http://www.opensource.apple.com/tarballs/cctools/cctools-809.tar.gz'
wget 'http://www.opensource.apple.com/tarballs/dyld/dyld-195.5.tar.gz'
wget 'http://www.opensource.apple.com/tarballs/ld64/ld64-127.2.tar.gz'
wget 'http://pkgs.fedoraproject.org/repo/pkgs/cdrkit/cdrkit-1.1.11.tar.gz/efe08e2f3ca478486037b053acd512e9/cdrkit-1.1.11.tar.gz'
wget 'https://github.com/theuni/libdmg-hfsplus/archive/libdmg-hfsplus-v0.1.tar.gz'
wget 'http://llvm.org/releases/3.2/clang+llvm-3.2-x86-linux-ubuntu-12.04.tar.gz' -O \
     clang-llvm-3.2-x86-linux-ubuntu-12.04.tar.gz
    wget 'https://raw.githubusercontent.com/theuni/osx-cross-depends/master/patches/cdrtools/genisoimage.diff' -O \
     cdrkit-deterministic.patch
cd ..
./bin/gbuild ../bitcoin/contrib/gitian-descriptors/boost-linux.yml
mv build/out/boost-*.zip inputs/
./bin/gbuild ../bitcoin/contrib/gitian-descriptors/deps-linux.yml
mv build/out/bitcoin-deps-*.zip inputs/
./bin/gbuild ../bitcoin/contrib/gitian-descriptors/qt-linux.yml
mv build/out/qt-*.tar.gz inputs/
./bin/gbuild ../bitcoin/contrib/gitian-descriptors/boost-win.yml
mv build/out/boost-*.zip inputs/
./bin/gbuild ../bitcoin/contrib/gitian-descriptors/deps-win.yml
mv build/out/bitcoin-deps-*.zip inputs/
./bin/gbuild ../bitcoin/contrib/gitian-descriptors/qt-win.yml
mv build/out/qt-*.zip inputs/
./bin/gbuild ../bitcoin/contrib/gitian-descriptors/protobuf-win.yml
mv build/out/protobuf-*.zip inputs/
./bin/gbuild ../bitcoin/contrib/gitian-descriptors/gitian-osx-native.yml
mv build/out/osx-*.tar.gz inputs/
./bin/gbuild ../bitcoin/contrib/gitian-descriptors/gitian-osx-depends.yml
mv build/out/osx-*.tar.gz inputs/
./bin/gbuild ../bitcoin/contrib/gitian-descriptors/gitian-osx-qt.yml
mv build/out/osx-*.tar.gz inputs/

flare · Jul 15, 2015

mraksel said:
how fix this ?
gitian@gitian:~/gitian-builder/inputs$ sudo wget svnboostorg/trac/boost/raw-attachment/ticket/7262/boost-mingw.patch' -O \
> boost-mingw-gas-cross-compile-2013-03-03.patch
--2015-07-15 06:53:58-- svnboostorg/trac/boost/raw-attachment/ticket/7262/boost-mingw.patch
Resolving svnboostorg (svnboostorg)... 129.79.39.203
Connecting to svnboostorg (svnboostorg)|129.79.39.203|:443... connected.
ERROR: The certificate of ‘svnboostorg’ is not trusted.
ERROR: The certificate of ‘svnboostorg’ has expired.
The certificate has expired

Use option '--no-check-certificate"

Code:

wget --no-check-certificate 'https://svn.boost.org/trac/boost/raw-attachment/ticket/7262/boost-mingw.patch' -O boost-mingw-gas-cross-compile-2013-03-03.patch

mraksel · Jul 15, 2015

download this sources in to input folder ?

Code:

gitian@gitian:~/gitian-builder$ ./bin/gbuild ../dash/contrib/gitian-descriptors/boost-win.yml
--- Building for precise amd64 ---
Stopping target if it is up
Making a new image copy
libexec/config-bootstrap-fixup: line 15: target-bin/bootstrap-fixup: Permission denied
./bin/gbuild:21:in `system!': failed to run make-clean-vm --suite precise --arch amd64 (RuntimeError)
  from ./bin/gbuild:57:in `build_one_configuration'
  from ./bin/gbuild:264:in `block (2 levels) in <main>'
  from ./bin/gbuild:259:in `each'
  from ./bin/gbuild:259:in `block in <main>'
  from ./bin/gbuild:257:in `each'
  from ./bin/gbuild:257:in `<main>'
gitian@gitian:~/gitian-builder$ sudo ./bin/gbuild ../dash/contrib/gitian-descriptors/boost-win.yml

************* WARNING: kvm not loaded, this will probably not work out

--- Building for precise amd64 ---
Stopping target if it is up
Making a new image copy
qemu-img: target-precise-amd64.qcow2: Could not open 'base-precise-amd64.qcow2': Could not open 'base-precise-amd64.qcow2': No such file or directory: No such file or directory
./bin/gbuild:21:in `system!': failed to run make-clean-vm --suite precise --arch amd64 (RuntimeError)
  from ./bin/gbuild:57:in `build_one_configuration'
  from ./bin/gbuild:264:in `block (2 levels) in <main>'
  from ./bin/gbuild:259:in `each'
  from ./bin/gbuild:259:in `block in <main>'
  from ./bin/gbuild:257:in `each'
  from ./bin/gbuild:257:in `<main>'
gitian@gitian:~/gitian-builder$

crowning · Jul 15, 2015

mraksel said:
...

Just a general remark: you use "sudo" all the time....can of worms because the created files will belong to user "root" and therefore other things will fail later on.

Use the EXACT commands as written in those Gitian installation guides....everything else might not fail but WILL fail.
Sooner or later.

When you're lucky sooner...

mraksel · Jul 15, 2015

i reinstall all end inputs start noraml build ,
but i hv

sudo: unable to resolve host gitian
stdin: is not a tty
Reading package lists... Done
Building dependency tree... Done
The following packages will be REMOVED:
rsyslog ubuntu-minimal
0 upgraded, 0 newly installed, 2 to remove and 0 not upgraded.
After this operation, 1289 kB disk space will be freed.
(Reading database ... 16065 files and directories currently installed.)
Removing ubuntu-minimal ...
Removing rsyslog ...
initctl: Unable to connect to Upstart: Failed to connect to socket /com/ubuntu/upstart: Connection refused
Processing triggers for ureadahead ...
Adding 'local diversion of /sbin/initctl to /sbin/initctl.distrib'
Adding 'local diversion of /usr/bin/ischroot to /usr/bin/ischroot.distrib'
Adding 'local diversion of /usr/sbin/policy-rc.d to /usr/sbin/policy-rc.d.distrib'
Starting target

or its normal ?

flare · Jul 15, 2015

mraksel said:
i reinstall all end inputs start noraml build ,
but i hv

sudo: unable to resolve host gitian
stdin: is not a tty
Reading package lists... Done
Building dependency tree... Done
The following packages will be REMOVED:
rsyslog ubuntu-minimal
0 upgraded, 0 newly installed, 2 to remove and 0 not upgraded.
After this operation, 1289 kB disk space will be freed.
(Reading database ... 16065 files and directories currently installed.)
Removing ubuntu-minimal ...
Removing rsyslog ...
initctl: Unable to connect to Upstart: Failed to connect to socket /com/ubuntu/upstart: Connection refused
Processing triggers for ureadahead ...
Adding 'local diversion of /sbin/initctl to /sbin/initctl.distrib'
Adding 'local diversion of /usr/bin/ischroot to /usr/bin/ischroot.distrib'
Adding 'local diversion of /usr/sbin/policy-rc.d to /usr/sbin/policy-rc.d.distrib'
Starting target

or its normal ?

It's normal, exactly what i get on our CI server --> https://dashpay.atlassian.net/builds/download/DASHL-DEV-JOB1/build_logs/DASHL-DEV-JOB1-132.log

Code:

error    15-Jul-2015 16:48:26    sudo: unable to resolve host gitian
error    15-Jul-2015 16:48:26    stdin: is not a tty
build    15-Jul-2015 16:49:43    Reading package lists...
build    15-Jul-2015 16:49:43    Building dependency tree...
build    15-Jul-2015 16:49:43    The following packages will be REMOVED:
build    15-Jul-2015 16:49:43      rsyslog ubuntu-minimal
build    15-Jul-2015 16:49:43    0 upgraded, 0 newly installed, 2 to remove and 0 not upgraded.
build    15-Jul-2015 16:49:43    After this operation, 1289 kB disk space will be freed.
build    15-Jul-2015 16:49:43    (Reading database ... 16065 files and directories currently installed.)
build    15-Jul-2015 16:49:43    Removing ubuntu-minimal ...
build    15-Jul-2015 16:49:43    Removing rsyslog ...
error    15-Jul-2015 16:49:43    initctl: Unable to connect to Upstart: Failed to connect to socket /com/ubuntu/upstart: Connection refused
build    15-Jul-2015 16:49:43    Processing triggers for ureadahead ...
build    15-Jul-2015 16:49:44    Adding 'local diversion of /sbin/initctl to /sbin/initctl.distrib'
build    15-Jul-2015 16:49:44    Adding 'local diversion of /usr/bin/ischroot to /usr/bin/ischroot.distrib'
build    15-Jul-2015 16:49:44    Adding 'local diversion of /usr/sbin/policy-rc.d to /usr/sbin/policy-rc.d.distrib'
build    15-Jul-2015 16:49:44    Starting target
build    15-Jul-2015 16:49:45    Checking if target is up
build    15-Jul-2015 16:49:45    Preparing build environment
build    15-Jul-2015 16:51:23    Updating apt-get repository (log in var/install.log)
build    15-Jul-2015 16:52:03    Installing additional packages (log in var/install.log)
error    15-Jul-2015 16:52:35    stdin: is not a tty
build    15-Jul-2015 16:52:35    Upgrading system, may take a while
build    15-Jul-2015 16:54:21    Creating package manifest
error    15-Jul-2015 16:54:22    stdin: is not a tty
build    15-Jul-2015 16:54:27    Creating build script (var/build-script)
build    15-Jul-2015 16:54:35    Running build script (log in var/build.log)
build    15-Jul-2015 17:02:41    Grabbing results
build    15-Jul-2015 17:02:48    Grabbing cache
build    15-Jul-2015 17:04:21    Generating report
build    15-Jul-2015 17:04:21    d4e63577d1489a8bda08618c2b8d48bc73904b664f44e0b6c509f038bf8886ab  dash-0.12.0-linux32.tar.gz
build    15-Jul-2015 17:04:21    0c1a5ea6b51dae3e594bae01013584274d722a74477e94cbc46892ebf547fdc7  dash-0.12.0-linux64.tar.gz
build    15-Jul-2015 17:04:21    0dcbba5113a5ab789a546ad816c18496e3cefe9d815be9b6407c1098aa718353  src/dash-0.12.0.tar.gz
build    15-Jul-2015 17:04:28    984ec9267fdfe83967fd219b1073b02286e76aeb65771ef238695b4fb002bdde  dash-linux-0.12-res.yml
build    15-Jul-2015 17:04:28    Done.

mraksel · Jul 15, 2015

all work

peakay · Jul 29, 2015

Code:

gitian@dash:~/gitian-builder$ ./bin/gbuild ../dash/contrib/gitian-descriptors/boost-win.yml
--- Building for precise amd64 ---
Stopping target if it is up
Making a new image copy
sudo: unable to resolve host gitian
stdin: is not a tty
Reading package lists... Done
Building dependency tree... Done
The following packages will be REMOVED:
  rsyslog ubuntu-minimal
0 upgraded, 0 newly installed, 2 to remove and 0 not upgraded.
After this operation, 1289 kB disk space will be freed.
(Reading database ... 16065 files and directories currently installed.)
Removing ubuntu-minimal ...
Removing rsyslog ...
initctl: Unable to connect to Upstart: Failed to connect to socket /com/ubuntu/upstart: Connection refused
Processing triggers for ureadahead ...
Adding 'local diversion of /sbin/initctl to /sbin/initctl.distrib'
Adding 'local diversion of /usr/bin/ischroot to /usr/bin/ischroot.distrib'
Adding 'local diversion of /usr/sbin/policy-rc.d to /usr/sbin/policy-rc.d.distrib'
Starting target
Checking if target is up
Preparing build environment
Updating apt-get repository (log in var/install.log)
Installing additional packages (log in var/install.log)
Upgrading system, may take a while
Creating package manifest
stdin: is not a tty
Creating build script (var/build-script)
Running build script (log in var/build.log)
./bin/gbuild:21:in `system!': failed to run on-target setarch x86_64 bash -x < var/build-script > var/build.log 2>&1 (RuntimeError)
        from ./bin/gbuild:137:in `build_one_configuration'
        from ./bin/gbuild:264:in `block (2 levels) in <main>'
        from ./bin/gbuild:259:in `each'
        from ./bin/gbuild:259:in `block in <main>'
        from ./bin/gbuild:257:in `each'
        from ./bin/gbuild:257:in `<main>'

I've managed to proceed through each build step until this point. I've also tried restarting, to no avail.

build.log

Code:

+ set -e
+ export LANG=en_US.UTF-8
+ LANG=en_US.UTF-8
+ export LC_ALL=en_US.UTF-8
+ LC_ALL=en_US.UTF-8
+ umask 002
+ export OUTDIR=/home/ubuntu/out
+ OUTDIR=/home/ubuntu/out
+ GBUILD_BITS=64
+ MAKEOPTS=(-j2)
+ REFERENCE_DATETIME='2011-01-30 00:00:00'
+ REFERENCE_DATE=2011-01-30
+ REFERENCE_TIME=00:00:00
+ cd build
+ export LD_PRELOAD=/usr/lib/faketime/libfaketime.so.1
+ LD_PRELOAD=/usr/lib/faketime/libfaketime.so.1
+ export 'FAKETIME=2011-01-30 00:00:00'
+ FAKETIME='2011-01-30 00:00:00'
+ export TZ=UTC
+ TZ=UTC
+ INDIR=/home/ubuntu/build
+ TEMPDIR=/home/ubuntu/tmp
+ echo 'fff00023dd79486d444c8e29922f4072e1d451fc5a4d2b6075852ead7f2b7b52  boost_1_55_0.tar.bz2'
+ shasum -c
boost_1_55_0.tar.bz2: OK
+ echo 'd2b7f6a1d7051faef3c9cf41a92fa3671d905ef1e1da920d07651a43299f6268  boost-mingw-gas-cross-compile-2013-03-03.patch'
+ shasum -c
boost-mingw-gas-cross-compile-2013-03-03.patch: FAILED
shasum: WARNING: 1 computed checksum did NOT match

flare · Jul 30, 2015

peakay said:

Code:

gitian@dash:~/gitian-builder$ ./bin/gbuild ../dash/contrib/gitian-descriptors/boost-win.yml
--- Building for precise amd64 ---
Stopping target if it is up
Making a new image copy
sudo: unable to resolve host gitian
stdin: is not a tty
Reading package lists... Done
Building dependency tree... Done
The following packages will be REMOVED:
  rsyslog ubuntu-minimal
0 upgraded, 0 newly installed, 2 to remove and 0 not upgraded.
After this operation, 1289 kB disk space will be freed.
(Reading database ... 16065 files and directories currently installed.)
Removing ubuntu-minimal ...
Removing rsyslog ...
initctl: Unable to connect to Upstart: Failed to connect to socket /com/ubuntu/upstart: Connection refused
Processing triggers for ureadahead ...
Adding 'local diversion of /sbin/initctl to /sbin/initctl.distrib'
Adding 'local diversion of /usr/bin/ischroot to /usr/bin/ischroot.distrib'
Adding 'local diversion of /usr/sbin/policy-rc.d to /usr/sbin/policy-rc.d.distrib'
Starting target
Checking if target is up
Preparing build environment
Updating apt-get repository (log in var/install.log)
Installing additional packages (log in var/install.log)
Upgrading system, may take a while
Creating package manifest
stdin: is not a tty
Creating build script (var/build-script)
Running build script (log in var/build.log)
./bin/gbuild:21:in `system!': failed to run on-target setarch x86_64 bash -x < var/build-script > var/build.log 2>&1 (RuntimeError)
        from ./bin/gbuild:137:in `build_one_configuration'
        from ./bin/gbuild:264:in `block (2 levels) in <main>'
        from ./bin/gbuild:259:in `each'
        from ./bin/gbuild:259:in `block in <main>'
        from ./bin/gbuild:257:in `each'
        from ./bin/gbuild:257:in `<main>'

I've managed to proceed through each build step until this point. I've also tried restarting, to no avail.

build.log

Code:

+ set -e
+ export LANG=en_US.UTF-8
+ LANG=en_US.UTF-8
+ export LC_ALL=en_US.UTF-8
+ LC_ALL=en_US.UTF-8
+ umask 002
+ export OUTDIR=/home/ubuntu/out
+ OUTDIR=/home/ubuntu/out
+ GBUILD_BITS=64
+ MAKEOPTS=(-j2)
+ REFERENCE_DATETIME='2011-01-30 00:00:00'
+ REFERENCE_DATE=2011-01-30
+ REFERENCE_TIME=00:00:00
+ cd build
+ export LD_PRELOAD=/usr/lib/faketime/libfaketime.so.1
+ LD_PRELOAD=/usr/lib/faketime/libfaketime.so.1
+ export 'FAKETIME=2011-01-30 00:00:00'
+ FAKETIME='2011-01-30 00:00:00'
+ export TZ=UTC
+ TZ=UTC
+ INDIR=/home/ubuntu/build
+ TEMPDIR=/home/ubuntu/tmp
+ echo 'fff00023dd79486d444c8e29922f4072e1d451fc5a4d2b6075852ead7f2b7b52  boost_1_55_0.tar.bz2'
+ shasum -c
boost_1_55_0.tar.bz2: OK
+ echo 'd2b7f6a1d7051faef3c9cf41a92fa3671d905ef1e1da920d07651a43299f6268  boost-mingw-gas-cross-compile-2013-03-03.patch'
+ shasum -c
": FAILED
shasum: WARNING: 1 computed checksum did NOT match

You'll need to download the dependencies first, the file "boost-mingw-gas-cross-compile-2013-03-03.patch" is one of these.
Follow "Fetch and build inputs: (first time, or when dependency versions change)" from https://github.com/dashpay/dash/blob/master/doc/release-process.md
where it states

Code:

cd inputs
wget 'http://miniupnp.free.fr/files/download.php?file=miniupnpc-1.9.20140701.tar.gz' -O miniupnpc-1.9.20140701.tar.gz
wget 'https://www.openssl.org/source/openssl-1.0.1k.tar.gz'
wget 'http://download.oracle.com/berkeley-db/db-4.8.30.NC.tar.gz'
wget 'http://zlib.net/zlib-1.2.8.tar.gz'
wget 'ftp://ftp.simplesystems.org/pub/png/src/history/libpng16/libpng-1.6.8.tar.gz'
wget 'https://fukuchi.org/works/qrencode/qrencode-3.4.3.tar.bz2'
wget 'https://downloads.sourceforge.net/project/boost/boost/1.55.0/boost_1_55_0.tar.bz2'
wget 'https://svn.boost.org/trac/boost/raw-attachment/ticket/7262/boost-mingw.patch' -O \
     boost-mingw-gas-cross-compile-2013-03-03.patch
wget 'https://download.qt-project.org/official_releases/qt/5.2/5.2.0/single/qt-everywhere-opensource-src-5.2.0.tar.gz'
wget 'https://download.qt-project.org/archive/qt/4.6/qt-everywhere-opensource-src-4.6.4.tar.gz'
wget 'https://protobuf.googlecode.com/files/protobuf-2.5.0.tar.bz2'
wget 'https://github.com/mingwandroid/toolchain4/archive/10cc648683617cca8bcbeae507888099b41b530c.tar.gz'
wget 'http://www.opensource.apple.com/tarballs/cctools/cctools-809.tar.gz'
wget 'http://www.opensource.apple.com/tarballs/dyld/dyld-195.5.tar.gz'
wget 'http://www.opensource.apple.com/tarballs/ld64/ld64-127.2.tar.gz'
wget 'http://pkgs.fedoraproject.org/repo/pkgs/cdrkit/cdrkit-1.1.11.tar.gz/efe08e2f3ca478486037b053acd512e9/cdrkit-1.1.11.tar.gz'
wget 'https://github.com/theuni/libdmg-hfsplus/archive/libdmg-hfsplus-v0.1.tar.gz'
wget 'http://llvm.org/releases/3.2/clang+llvm-3.2-x86-linux-ubuntu-12.04.tar.gz' -O \
     clang-llvm-3.2-x86-linux-ubuntu-12.04.tar.gz
    wget 'https://raw.githubusercontent.com/theuni/osx-cross-depends/master/patches/cdrtools/genisoimage.diff' -O \
     cdrkit-deterministic.patch

peakay · Jul 30, 2015

flare said:
You'll need to download the dependencies first, the file "boost-mingw-gas-cross-compile-2013-03-03.patch" is one of these.
Follow "Fetch and build inputs: (first time, or when dependency versions change)" from snip
where it states

Code:

cd inputs snip

These are the deps that I have downloaded, which I believe is everything from that list, including the file that you mentioned.

Code:

gitian@dash:~/gitian-builder/inputs$ ls
10cc648683617cca8bcbeae507888099b41b530c.tar.gz  cdrkit-deterministic.patch                    protobuf-2.5.0.tar.bz2
bitcoin-deps-linux32-gitian-r9.zip               clang-llvm-3.2-x86-linux-ubuntu-12.04.tar.gz  qrencode-3.4.3.tar.bz2
bitcoin-deps-linux64-gitian-r9.zip               db-4.8.30.NC.tar.gz                           qt-everywhere-opensource-src-4.6.4.tar.gz
boost_1_55_0.tar.bz2                             dyld-195.5.tar.gz                             qt-everywhere-opensource-src-5.2.0.tar.gz
boost-linux32-1.55.0-gitian-r1.zip               ld64-127.2.tar.gz                             qt-linux32-4.6.4-gitian-r1.tar.gz
boost-linux64-1.55.0-gitian-r1.zip               libdmg-hfsplus-v0.1.tar.gz                    qt-linux64-4.6.4-gitian-r1.tar.gz
boost-mingw-gas-cross-compile-2013-03-03.patch   libpng-1.6.8.tar.gz                           zlib-1.2.8.tar.gz
cctools-809.tar.gz                               miniupnpc-1.9.20140701.tar.gz
cdrkit-1.1.11.tar.gz                             openssl-1.0.1k.tar.gz

How to gitian build dash under Debian Jessie using lxc

Member

Member

Member

Member

Member

Member

Well-known member

Member

Member

Member

Well-known member

Well-known member

Member

Well-known member

Member

Well-known member

Member

New member

Well-known member

New member