Favourite Jenkins plugins

Technical, Technology
  • Subversion
  • Maven Integration
  • Emma
  • FindBugs
  • PMD
  • Checkstyle
  • Monitoring

Install rpmforge in CEntOS

Technical, Technology

c.f. http://dag.wieers.com/rpm/FAQ.php#B

Install hddtemp in CentOS – to check harddisk temperature in Linux

Technical, Technology

Assuming you are now logged in as root.

  1. Add repository
  2. yum update
  3. yum install hddtemp

Using Mirrors for Repositories

Technical, Technology

Creating a local mirror of maven repository often saves your developers a lot of time waiting for getting everything from a repository. Just by modifying the settings.xml can do, e.g.:

         <name>UK Central</name>

See the links for more details:

Quick Sample – logrotate


Configuration file for logrotate: /etc/logrotate.conf

# see "man logrotate" for details
# rotate log files weekly

# keep 4 weeks worth of backlogs
rotate 4

# create new (empty) log files after rotating old ones

# uncomment this if you want your log files compressed
# RPM packages drop log rotation information into this directory
include /etc/logrotate.d

# no packages own wtmp -- we'll rotate them here
/var/log/wtmp {
minsize 1M
create 0664 root utmp
rotate 1

# system-specific logs may be also be configured here.

Path for logrotate application-specific configurations: /etc/logrotate.d

A quick and good sample – /etc/logrotate.d/httpd

/var/log/httpd/*log {
/sbin/service httpd reload > /dev/null 2>/dev/null || true

Quick Recipe – setting up master-slave subversion servers with replication using svnsync and transparent proxy in Ubuntu


If you are having enough background, this article is a shortcut for you to set up a group of SVN servers with one master and one slave (you should be able to generalize it to multiple slaves with some minor touches). This group of SVN servers could be synchronized (or replicated) to allow multi-site deployment for network efficiency. However, you could always refer to this article for details on setting up svnsync and this article for setting up ssh login without password.

Assumed you are given:

  1. A master SVN server ([Master]) access via HTTP with a proper repository setup at /var/svn/repos. (You could refer to this article for setting up an SVN server.)
  2. A slave SVN server ([Slave]) accessed via HTTP (with an empty repository /var/svn/repos created as in this article).
  3. The credentials for accessing the master and slave SVN servers are identical.
  4. The master and slave SVN servers can access each other.

To set this up, follow the recipe:

  1. [Slave] cd /etc/apache2/mods-enabled; sudo ln -s ../mods-available/proxy.load; sudo ln -s ../mods-available/proxy_http.load
  2. [Slave] Add a SVNMasterURI directive under the <Location> directive in /etc/apache2/mods-available/dav_svn.conf (details)
  3. [Slave] sudo adduser svnsync
  4. [Slave] sudo adduser svnsync svn
  5. [Slave] sudo chown -R svnsync:svn /var/svn/repos
  6. [Slave] Create a script /var/svn/repos/hooks/pre-revprop-change (details)
  7. [Slave] sudo chmod +x /var/svn/repos/hooks/pre-revprop-change
  8. [Slave] sudo svnsync init –username svnsync file:///var/svn/repos http://<master hostname>/svn/repos
  9. [Slave] Download the script svn-sync-slave.sh and put under /var
  10. [Slave] Modify the first line of /var/svn-sync-slave.sh from #!/bin/sh to #!/bin/bash
  11. [Slave] sudo chown svnsync:svn /var/svn-sync-slave.sh; sudo chmod +x /var/svn-sync-slave.sh
  12. [Master] Create a script /var/svn/repos/hooks/post-commit (details)
  13. [Master] sudo chown www-data:svn /var/svn/repos/hooks/post-commit; sudo chmod g+rws /var/svn/repos/hooks/post-commit
  14. [Master] sudo -i
  15. [Master] su – www-data
  16. [Master] ssh-keygen -t rsa (give empty passphrase)
  17. [Master] ssh svnsync@<slave hostname> mkdir -p .ssh
  18. [Master] cat .ssh/id_rsa.pub | ssh svnsync@<slave hostname> ‘cat >> .ssh/authorized_keys’

To test this setup:

  1. Find another computer with svn client installed. ([Client])
  2. [Client] svn import –username <user> <path to local folder> http://<slave hostname>/svn/repos
  3. Check whether the imported folders and files are in both master and slave SVN servers’ repositories.
  4. [Client] Pick any one file imported.  Modify it and commit it to http://<slave hostname>/svn/repos.
  5. Check whether the modified file is in both master and slave SVN servers’ repositories.

Update on 2011-07-28:

There is something subtle that needs special consideration.

In fact, when I try to apply this procedures to an old and big svn repository, there is a problem.  I tried to start synchronizing with a new repository (you have to start from scratch anyway!) over the network.  I then tried to do a rough gauging and calculation exercise.  It needs to take 3 months to sync them all (yes, days and nights, continuously).

Luckily, we resolved it by using the file-based nature of svn.  We first make a sync in the same machine.  But note that you should use the target url as the master url, i.e. you should use IP / hostname to sync instead of localhost as svnsync remembers the url you used to init the sync process.

Then, after the sync process is done (which is much much much faster), zip the whole repository and upload to the target slave machine.  In the slave machine, you could expand and rename the repository as you like.  At this point, the svnsync becomes incremental.  So it would not take you much time to do a few revisions’ synchronization.

Details here:

[Slave] Add a SVNMasterURI directive under the <Location> directive in /etc/apache2/mods-available/dav_svn.conf

SVNMasterURI http://<master hostname>/svn/repos

[Slave] Create a script /var/svn/repos/hooks/pre-revprop-change


if [ "$USER" != "svnsync" ]; then
    echo >&2 "Only the svnsync user can change revprops"
    exit 1

exit 0

[Master] Create a script /var/svn/repos/hooks/post-commit


ssh -l svnsync <slave hostname> "/var/svn-sync-slave.sh -r /var/svn/repos"

Quick Recipe – Setting up a Subversion Server to be Accessed via HTTP in Ubuntu


If you are having enough background, this article is a shortcut for you to set up a subversion server.  You could always refer to this article for more details.

Assumed you are given:

  1. An installation of Ubuntu Linux with access to APT repositories via network.
  2. Installed Apache2 web server.

To install subversion, follow this recipe:

  1. sudo apt-get install subversion
  2. sudo adduser svn
  3. sudo adduser www-data svn
  4. sudo mkdir /var/svn
  5. sudo svnadmin create /var/svn/repos
  6. sudo chown -R www-data:svn /var/svn/repos
  7. sudo chmod g+rws /var/svn/repos
  8. sudo apt-get install libapache2-svn
  9. Add a <Location> to /etc/apache2/mods-available/dav_svn.conf (details)
  10. (Optional) cd /etc/apache2/mods-enabled; sudo ln -s ../mods-available/dav_svn.load; sudo ln -s ../mods-available/dav_svn.conf
  11. sudo /etc/init.d/apache2 restart
  12. sudo htpasswd -c /etc/htpasswd.svn <1st user>
  13. sudo htpasswd /etc/htpasswd.svn <2nd user>

To test the installation and setup:

  1. cat /etc/htpasswd.svn
  2. svn co http://<hostname>/svn/repos mycopy –username <user>

Details here:
Add a <Location> snippet to /etc/apache2/mods-available/dav_svn.conf

<Location /svn/repos>
     DAV svn
     SVNPath /var/svn/repos
     AuthType Basic
     AuthName "SVN repository"
     AuthUserFile /etc/htpasswd.svn
     AuthzSVNAccessFile /var/svn/repos/conf/authz
        Require valid-user