Simplest Enterprise Continuous Integration Solutions

Saturday, September 10, 2011

Enterprise Linux - add hard drive

Here are the procedures to add a new hard drive for vSphere (VMWare ESXI 4.0.0) virtual machine.
  • vSphere Client -> virtual machine “Summary” tab -> "Edit Setting" -> Virtual Machine Properties panel “Hardware” tab -> click "Add" -> popup a "Add Hardware" panel
  • "Add Hardware" panel -> select "Hard Disk", click "Next" -> select "Create a new virtual disk" (by default), click "Next" -> select "Disk Size" to 8GB, click "Next" -> select "Virtual Device Node SCSI(0:1)" (by default), click "Next" -> click "Finish"
  • click "OK" on "Virtual Machine Properties" panel
  • vSphere Client -> virtual machine “Summary” tab -> "Refresh Storage Usage"
  • reboot virtual machine
[root@linux64 ~]# ls -l /dev/sd*
# set partition
brw-r----- 1 root disk 8,  0 Sep 14  2011 /dev/sda
brw-r----- 1 root disk 8,  1 Sep 14  2011 /dev/sda1
brw-r----- 1 root disk 8,  2 Sep 14  2011 /dev/sda2
brw-r----- 1 root disk 8, 16 Sep 14  2011 /dev/sdb
[root@linux64 ~]# df -h
Filesystem                      Size Used Avail Use%  Mounted on
/dev/mapper/VolGroup00-LogVol00 33G  3.4G 28G   11%   /
/dev/sda1                       99M  22M  73M   23%   /boot
tmpfs                           4.0G 0    4.0G  0%    /dev/shm
[root@linux64 ~]# fdisk /dev/sdb
Command (m for help): p
Disk /dev/sdb: 8589 MB, 8589934592 bytes
255 heads, 63 sectors/track, 1044 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
   Device Boot      Start         End      Blocks   Id  System
Command (m for help): n
Command action
   e   extended
   p   primary partition (1-4)
p
Partition number (1-4): 1
First cylinder (1-1044, default 1): 1
Last cylinder or +size or +sizeM or +sizeK (1-1044, default 1044): 1044
Command (m for help): p
Disk /dev/sdb: 8589 MB, 8589934592 bytes
255 heads, 63 sectors/track, 1044 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
   Device Boot      Start         End      Blocks   Id  System
   /dev/sdb1        1             1044     8385898+ 83  Linux
Command (m for help): w
The partition table has been altered!
Calling ioctl() to re-read partition table.
Syncing disks.
[root@linux64 ~]# ls -l /dev/sd*
brw-r----- 1 root disk 8,  0 Sep 14  2011 /dev/sda
brw-r----- 1 root disk 8,  1 Sep 14  2011 /dev/sda1
brw-r----- 1 root disk 8,  2 Sep 14  2011 /dev/sda2
brw-r----- 1 root disk 8, 16 Apr 16 18:19 /dev/sdb
brw-r----- 1 root disk 8, 17 Apr 16 18:19 /dev/sdb1
# format new drive
[root@linux64 ~]# mkfs -t ext3 /dev/sdb1
mke2fs 1.39 (29-May-2006)
Filesystem label=
OS type: Linux
Block size=4096 (log=2)
Fragment size=4096 (log=2)
1048576 inodes, 2096474 blocks
104823 blocks (5.00%) reserved for the super user
First data block=0
Maximum filesystem blocks=2147483648
64 block groups
32768 blocks per group, 32768 fragments per group
16384 inodes per group
Superblock backups stored on blocks:
        32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632
Writing inode tables: done
Creating journal (32768 blocks): done
Writing superblocks and filesystem accounting information: done
This filesystem will be automatically checked every 24 mounts or
180 days, whichever comes first.  Use tune2fs -c or -i to override.
# mount new drive
[root@linux64 ~]# mkdir /mnt1
[root@linux64 ~]# cat /etc/fstab
/dev/VolGroup00/LogVol00 /                       ext3    defaults        1 1
LABEL=/boot              /boot                   ext3    defaults        1 2
tmpfs                    /dev/shm                tmpfs   defaults        0 0
devpts                   /dev/pts                devpts  gid=5,mode=620  0 0
sysfs                    /sys                    sysfs   defaults        0 0
proc                     /proc                   proc    defaults        0 0
/dev/VolGroup00/LogVol01 swap                    swap    defaults        0 0
/dev/sdb1                /mnt1                   ext3    defaults        1 2
[root@linux64 ~]# mount /dev/sdb1
[root@linux64 ~]# mount
/dev/mapper/VolGroup00-LogVol00 on / type ext3 (rw)
proc on /proc type proc (rw)
sysfs on /sys type sysfs (rw)
devpts on /dev/pts type devpts (rw,gid=5,mode=620)
/dev/sda1 on /boot type ext3 (rw)
tmpfs on /dev/shm type tmpfs (rw)
none on /proc/sys/fs/binfmt_misc type binfmt_misc (rw)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw)
/dev/sdb1 on /mnt1 type ext3 (rw)
[root@linux64 ~]# df -h
Filesystem                      Size Used Avail Use%  Mounted on 33G  3.4G 28G   11%   /
/dev/mapper/VolGroup00-LogVol00
/dev/sda1                       99M  22M  73M   23%   /boot
tmpfs                           4.0G 0    4.0G  0%    /dev/shm
/dev/sdb1                       7.9G 147M 7.4G  2%    /mnt1

Saturday, September 3, 2011

Java MultiThreads on Linux


Java MultiThreads wrapped as a Linux (x86-64) Daemon with below directory structure:
MultiThreads-linux-x86-64/
                         /conf/
                              /wrapper.conf
                         /lib
                             /commons-io-2.0.1.jar
                             /libwrapper.so
                             /wrapperdemo.jar
                             /wrapper.jar
                             /wrappertest.jar
                             /yamlbeans-1.0.jar
                         /logs
                         /MultiThreads.jar
                         /MultiThreads.sh
                         /receiveInputsFromYamls/
                         /invokeMultiThreadExecutions/
                         /wrapper


MultiThreads.jar which listens yaml format file as inputs from  MultiThreads-linux-x86-64/receiveInputsFromYamls, and execute the executions with outputs to MultiThreads-linux-x86-64/invokeMultiThreadExecutions/ in Java multithreads mode.


yaml format file inputs content:
name: task1
command: execute_something


MultiThreads-linux-x86-64/conf/wrapper.conf content:
#encoding=UTF-8
# Configuration files must begin with a line specifying the encoding
#  of the the file.


#********************************************************************
# Wrapper License Properties (Ignored by Community Edition)
#********************************************************************
# Professional and Standard Editions of the Wrapper require a valid
#  License Key to start.  Licenses can be purchased or a trial license
#  requested on the following pages:
# http://wrapper.tanukisoftware.com/purchase
# http://wrapper.tanukisoftware.com/trial


# Include file problems can be debugged by removing the first '#'
#  from the following line:
##include.debug


# The Wrapper will look for either of the following optional files for a
#  valid License Key.  License Key properties can optionally be included
#  directly in this configuration file.
#include ../conf/wrapper-license.conf
#include ../conf/wrapper-license-%WRAPPER_HOST_NAME%.conf


# The following property will output information about which License Key(s)
#  are being found, and can aid in resolving any licensing problems.
#wrapper.license.debug=TRUE


#********************************************************************
# Wrapper Localization
#********************************************************************
# Specify the locale which the Wrapper should use.  By default the system
#  locale is used.
#wrapper.lang=en_US # en_US or ja_JP


# Specify the location of the Wrapper's language resources.  If these are
#  missing, the Wrapper will default to the en_US locale.
wrapper.lang.folder=../lang


#********************************************************************
# Wrapper Java Properties
#********************************************************************
# Java Application
#  Locate the java binary on the system PATH:
#wrapper.java.command=java
#  Specify a specific java binary:
set.JAVA_HOME=/usr/java/jdk1.6.0_23
wrapper.java.command=%JAVA_HOME%/bin/java


# Tell the Wrapper to log the full generated Java command line.
wrapper.java.command.loglevel=INFO


# Java Main class.  This class must implement the WrapperListener interface
#  or guarantee that the WrapperManager class is initialized.  Helper
#  classes are provided to do this for you.  See the Integration section
#  of the documentation for details.
wrapper.java.mainclass=org.tanukisoftware.wrapper.WrapperSimpleApp


# Java Classpath (include wrapper.jar)  Add class path elements as
#  needed starting from 1
wrapper.java.classpath.1=lib/wrapper.jar
wrapper.java.classpath.2=MultiThreads.jar


# Java Library Path (location of Wrapper.DLL or libwrapper.so)
wrapper.java.library.path.1=lib


# Java Bits.  On applicable platforms, tells the JVM to run in 32 or 64-bit mode.
wrapper.java.additional.auto_bits=TRUE


# Java Additional Parameters
wrapper.java.additional.1=


# Initial Java Heap Size (in MB)
wrapper.java.initmemory=128


# Maximum Java Heap Size (in MB)
wrapper.java.maxmemory=512


# Application parameters.  Add parameters as needed starting from 1
wrapper.app.parameter.1=com.acme.multithreads.MultiTheads


#********************************************************************
# Wrapper Logging Properties
#********************************************************************
# Enables Debug output from the Wrapper.
# wrapper.debug=TRUE


# Format of output for the console.  (See docs for formats)
wrapper.console.format=PM


# Log Level for console output.  (See docs for log levels)
wrapper.console.loglevel=INFO


# Log file to use for wrapper output logging.
wrapper.logfile=logs/wrapper.log


# Format of output for the log file.  (See docs for formats)
wrapper.logfile.format=LPTM


# Log Level for log file output.  (See docs for log levels)
wrapper.logfile.loglevel=INFO


# Maximum size that the log file will be allowed to grow to before
#  the log is rolled. Size is specified in bytes.  The default value
#  of 0, disables log rolling.  May abbreviate with the 'k' (kb) or
#  'm' (mb) suffix.  For example: 10m = 10 megabytes.
wrapper.logfile.maxsize=0


# Maximum number of rolled log files which will be allowed before old
#  files are deleted.  The default value of 0 implies no limit.
wrapper.logfile.maxfiles=0


# Log Level for sys/event log output.  (See docs for log levels)
wrapper.syslog.loglevel=NONE


#********************************************************************
# Wrapper General Properties
#********************************************************************
# Allow for the use of non-contiguous numbered properties
wrapper.ignore_sequence_gaps=TRUE


# Title to use when running as a console
wrapper.console.title=MultiThreads


#********************************************************************
# Wrapper JVM Checks
#********************************************************************
# Detect DeadLocked Threads in the JVM. (Requires Standard Edition)
wrapper.check.deadlock=TRUE
wrapper.check.deadlock.interval=60
wrapper.check.deadlock.action=RESTART
wrapper.check.deadlock.output=FULL


# Out Of Memory detection.
# (Simple match)
wrapper.filter.trigger.1000=java.lang.OutOfMemoryError
# (Only match text in stack traces if -XX:+PrintClassHistogram is being used.)
#wrapper.filter.trigger.1000=Exception in thread "*" java.lang.OutOfMemoryError
#wrapper.filter.allow_wildcards.1000=TRUE
wrapper.filter.action.1000=RESTART
wrapper.filter.message.1000=The JVM has run out of memory.


#********************************************************************
# Wrapper Email Notifications. (Requires Professional Edition)
#********************************************************************
# Common Event Email settings.
#wrapper.event.default.email.debug=TRUE
#wrapper.event.default.email.smtp.host=<SMTP_Host>
#wrapper.event.default.email.smtp.port=25
#wrapper.event.default.email.subject=[%WRAPPER_HOSTNAME%:%WRAPPER_NAME%:%WRAPPER_EVENT_NAME%] Event Notification
#wrapper.event.default.email.sender=<Sender email>
#wrapper.event.default.email.recipient=<Recipient email>


# Configure the log attached to event emails.
#wrapper.event.default.email.attach_log=TRUE
#wrapper.event.default.email.maillog.lines=50
#wrapper.event.default.email.maillog.format=LPTM
#wrapper.event.default.email.maillog.loglevel=INFO


# Enable specific event emails.
#wrapper.event.wrapper_start.email=TRUE
#wrapper.event.jvm_prelaunch.email=TRUE
#wrapper.event.jvm_start.email=TRUE
#wrapper.event.jvm_started.email=TRUE
#wrapper.event.jvm_deadlock.email=TRUE
#wrapper.event.jvm_stop.email=TRUE
#wrapper.event.jvm_stopped.email=TRUE
#wrapper.event.jvm_restart.email=TRUE
#wrapper.event.jvm_failed_invocation.email=TRUE
#wrapper.event.jvm_max_failed_invocations.email=TRUE
#wrapper.event.jvm_kill.email=TRUE
#wrapper.event.jvm_killed.email=TRUE
#wrapper.event.jvm_unexpected_exit.email=TRUE
#wrapper.event.wrapper_stop.email=TRUE


# Specify custom mail content
wrapper.event.jvm_restart.email.body=The JVM was restarted.\n\nPlease check on its status.\n


#********************************************************************
# Wrapper Windows NT/2000/XP Service Properties
#********************************************************************
# WARNING - Do not modify any of these properties when an application
#  using this configuration file has been installed as a service.
#  Please uninstall the service before modifying this section.  The
#  service can then be reinstalled.


# Name of the service
wrapper.name=@app.name@


# Display name of the service
wrapper.displayname=@app.long.name@


# Description of the service
wrapper.description=@app.long.name@


# Service dependencies.  Add dependencies as needed starting from 1
wrapper.ntservice.dependency.1=


# Mode in which the service is installed.  AUTO_START, DELAY_START or DEMAND_START
wrapper.ntservice.starttype=AUTO_START


# Allow the service to interact with the desktop.
wrapper.ntservice.interactive=false


Run as Linux Daemon mode

  • MultiThreads-linux-x86-64/MultiThreads.sh remove
  • MultiThreads-linux-x86-64/MultiThreads.sh install
  • MultiThreads-linux-x86-64/MultiThreads.sh start

Run as console mode

  • MultiThreads-linux-x86-64\MultiThreads.bat console