Changes between Version 44 and Version 45 of 3D_Lustre


Ignore:
Timestamp:
Sep 5, 2008, 10:49:47 PM (16 years ago)
Author:
rider
Comment:

--

Legend:

Unmodified
Added
Removed
Modified

  • 3D_Lustre

    v44 v45  
    104104
    105105rock@fly:~/turbojpeg> wget ftp://ftp.pbone.net/mirror/ftp.sourceforge.net/pub/sourceforge/v/vi/virtualgl/turbojpeg-1.10.3.x86_64.rpm  [[BR]]
    106 rock@fly:~/turbojpeg> sudo rpm -ivh turbojpeg-1.10.3.x86_64.rpm  [[BR]]
    107 rock@fly:~/turbojpeg> sudo rpm -qs turbojpeg  [[BR]]
    108 rock@fly:~/VirtualGL> switchtjpeg --help [[BR]]
    109 
    110 {{{
    111 USAGE: /usr/bin/switchtjpeg < ipp | libjpeg >
    112 
    113 ipp = Use the accelerated version of TurboJPEG, which embeds functions from
    114       the Intel(R) Integrated Performance Primitives
    115 libjpeg = Use the unaccelerated version of TurboJPEG, which is
    116           GPL-compatible
    117 }}}
     106rock@fly:~/turbojpeg> sudo rpm -Uivh turbojpeg-1.10.3.x86_64.rpm  [[BR]]
    118107
    119108== 7.Install VirtualGL ==
    120109
    121110rock@fly:~/VirtualGL> wget ftp://ftp.pbone.net/mirror/ftp.sourceforge.net/pub/sourceforge/v/vi/virtualgl/VirtualGL-2.1.x86_64.rpm  [[BR]]
    122 rock@fly:~/VirtualGL> sudo rpm -ivh VirtualGL-2.1.x86_64.rpm [[BR]]
    123 rock@fly:~/VirtualGL> sudo rpm -qs VirtualGL (Check) [[BR]]
    124 rock@fly:~/VirtualGL> vglrun --help
     111rock@fly:~/VirtualGL> sudo rpm -Uivh VirtualGL-2.1.x86_64.rpm [[BR]]
    125112
    126113### VGL Server Configuration [[BR]]
    … …  
    146133Disable XTEST extension (recommended)?
    147134[Y/n]
    148 Y
     135n
    149136... Granting write permission to /dev/nvidia* for all users ...
    150137... Adding xhost +localhost to /etc/X11/xdm/Xsetup script ...
    … …  
    167154== 8.Install TurboVNC ==
    168155
    169 rock@fly:~/turbovnc> wget http://downloads.sourceforge.net/virtualgl/turbovnc-0.4.i386.rpm?modtime=1205803835&big_mirror=0  [[BR]]
    170 rock@fly:~/turbovnc> sudo rpm -ivh turbovnc-0.4.i386.rpm  [[BR]]
    171 rock@fly:~/turbovnc> rpm -qs turbovnc (Check) [[BR]]
    172156rock@fly:~> sudo zypper install xorg-x11-fonts xorg-x11-fonts-core xorg-x11-fonts-devel  [[BR]]
    173157rock@fly:~> sudo zypper install xorg-x11-devel xorg-x11-driver-input xorg-x11-driver-video [[BR]]
    174158rock@fly:~> sudo zypper install libdrm libdrm-devel Mesa Mesa-devel [[BR]]
    175159rock@fly:~> sudo zypper remove beagle beagle-evolution beagle-firefox beagle-gui beagle-index tomboy [[BR]]
     160rock@fly:~/turbovnc> wget http://downloads.sourceforge.net/virtualgl/turbovnc-0.4.i386.rpm?modtime=1205803835&big_mirror=0  [[BR]]
     161rock@fly:~/turbovnc> sudo rpm -Uivh turbovnc-0.4.i386.rpm  [[BR]]
    176162rock@fly:/usr/X11R6/lib> sudo /etc/init.d/xfs start  [[BR]]
    177163rock@fly:~> cd /usr/X11R6/lib  [[BR]]
    … …  
    187173  Load         "extmod"
    188174  Load         "glx"
    189   Load         "v4l"
    190175  Load         "drm"
    191176  Load         "dri"
    … …  
    205190EndSection
    206191}}}
    207 
    208 rock@fly:~> sudo vim /etc/sysconfig/displaymanager [[BR]]
    209 
    210 {{{
    211 ## Type:        string(Xorg,Xgl)
    212 ## Path:        Desktop/Display manager
    213 ## Default:     "Xorg"
    214 #
    215 # Xgl is an experimental Xserver using OpenGL for rendering
    216 # Right now only the glx backend is supported, which runs on top of a
    217 # standard Xorg server providing OpenGL.
    218 # Set this to 'Xgl' and run SuSEconfig only if you want to run your
    219 # displaymanager (kdm/gdm/xdm) on Xgl on top of Xorg.
    220 # This setting is case sensitive.
    221 # Warning! This is highly experimental.
    222 
    223 ## If we use Xgl setting to run gdm, we no longer get 3D Direct Rendering but rather software rendering. XGL still gives you 3D but not through Direct Rendering. To get the git for the latest Xorg may solve this bug. (Dependency: Current-> libdrm-2.3.0) 
    224 
    225 DISPLAYMANAGER_XSERVER="Xorg"
    226 DISPLAYMANAGER_XGL_OPTS="-accel glx:pbuffer -accel xv:pbuffer"
    227 DISPLAYMANAGER="gdm"
    228 DISPLAYMANAGER_REMOTE_ACCESS="yes"
    229 DISPLAYMANAGER_ROOT_LOGIN_REMOTE="yes"
    230 DISPLAYMANAGER_STARTS_XSERVER="yes"
    231 }}}
    232 
    233 ### Source code repositories ###
    234 
    235 '''X.org driver'''
    236 {{{
    237 rock@fly:~> git-clone git://anongit.freedesktop.org/git/xorg/driver/xf86-video-intel
    238 }}}
    239 
    240 '''Mesa 3D GL Driver''' [[BR]]
    241 # Chip: Intel Corporation 82Q963/Q965 Integrated Graphics [[BR]]
    242 # Update Mesa-7.0.1 (Current) -> Mesa-7.0.4 (Last Stable release)  [[BR]]
    243 # rock@fly:~> git-clone git://anongit.freedesktop.org/git/mesa/mesa (The latest Mesa 7.1.0 -> Dependency -> libdrm-2.3.1 higher! Do not fit current system ) [[BR]]
    244 rock@fly:~> wget http://downloads.sourceforge.net/mesa3d/MesaLib-7.0.4.tar.gz?modtime=1218883994&big_mirror=0 (Mesa 7.0.4 -> Dependency -> libdrm-2.3.0) [[BR]]
    245 rock@fly:~> tar zxvf MesaLib-7.0.4.tar.gz [[BR]]
    246 rock@fly:~> cd ./Mesa-7.0.4/ [[BR]]
    247 rock@fly:~> make linux-dri-x86-64 -j 4 [[BR]]
    248 rock@fly:~> sudo make install (Default PATH:/usr/local/lib64/) [[BR]]
    249 rock@fly:~> ldd /usr/bin/glxinfo [[BR]]
    250         '''libGLU.so.1 => /usr/lib64/libGLU.so.1 (0x00002b0473cee000)''' ---> Mesa library [[BR]]
    251         '''libGL.so.1 => /usr/lib64/libGL.so.1 (0x00002b0473f5a000)'''   ---> Mesa library [[BR]]
    252         libXext.so.6 => /usr/lib64/libXext.so.6 (0x00002b04741d6000) [[BR]]
    253         libX11.so.6 => /usr/lib64/libX11.so.6 (0x00002b04743e8000) [[BR]]
    254         libpthread.so.0 => /lib64/libpthread.so.0 (0x00002b047471e000) [[BR]]
    255         libm.so.6 => /lib64/libm.so.6 (0x00002b0474939000) [[BR]]
    256         libc.so.6 => /lib64/libc.so.6 (0x00002b0474b8d000) [[BR]]
    257         libstdc++.so.6 => /usr/lib64/libstdc++.so.6 (0x00002b0474ed2000) [[BR]]
    258         libgcc_s.so.1 => /lib64/libgcc_s.so.1 (0x00002b04751da000) [[BR]]
    259         libXxf86vm.so.1 => /usr/lib64/libXxf86vm.so.1 (0x00002b04753e9000) [[BR]]
    260         libXdamage.so.1 => /usr/lib64/libXdamage.so.1 (0x00002b04755ef000) [[BR]]
    261         libXfixes.so.3 => /usr/lib64/libXfixes.so.3 (0x00002b04757f2000) [[BR]]
    262         libdl.so.2 => /lib64/libdl.so.2 (0x00002b04759f9000) [[BR]]
    263         libdrm.so.2 => /usr/lib64/libdrm.so.2 (0x00002b0475bfd000) [[BR]]
    264         libXau.so.6 => /usr/lib64/libXau.so.6 (0x00002b0475e08000) [[BR]]
    265         libxcb-xlib.so.0 => /usr/lib64/libxcb-xlib.so.0 (0x00002b047600c000) [[BR]]
    266         libxcb.so.1 => /usr/lib64/libxcb.so.1 (0x00002b047620e000) [[BR]]
    267         /lib64/ld-linux-x86-64.so.2 (0x00002b0473ad1000) [[BR]]
    268 rock@fly:~> sudo rm /usr/lib64/libGLU.so libGLU.so.1 libGL.so libGL.so.1 (Remove these old links) [[BR]]
    269 rock@fly:~> sudo cp /usr/local/lib64/libGL.so.1.2 /usr/lib64 [[BR]]
    270 rock@fly:~> sudo cp /usr/local/lib64/libGLU.so.1.3.070004 /usr/lib64 [[BR]]
    271 rock@fly:~> cd /usr/lib64 [[BR]]
    272 rock@fly:~> sudo ln -s libGLU.so.1.3.070004 libGLU.so.1 [[BR]]
    273 rock@fly:~> sudo ln -s libGLU.so.1 libGLU.so [[BR]]
    274 rock@fly:~> sudo ln -s libGL.so.1.2 libGL.so.1 [[BR]]
    275 rock@fly:~> sudo ln -s libGL.so.1 libGL.so [[BR]]
    276 {{{
    277 Sanity Check:
    278 rock@fly:~> glxinfo -display :0 ( Direct Rendering )
    279 name of display: :0.0
    280 display: :0  screen: 0
    281 direct rendering: Yes
    282 server glx vendor string: SGI
    283 server glx version string: 1.2
    284 OpenGL vendor string: Tungsten Graphics, Inc
    285 OpenGL renderer string: Mesa DRI Intel(R) 965Q 4.1.3002
    286 OpenGL version string: 1.4 Mesa 7.0.4
    287 }}}
    288 
    289 '''DRM Kernel module - For libdrm''' [[BR]]
    290 # Update to the latest libdrm [[BR]]
    291 rock@fly:~> git-clone git://anongit.freedesktop.org/git/mesa/drm [[BR]]
    292 rock@fly:~> cd ./drm [[BR]]
    293 rock@fly:~> ./autogen.sh --prefix=/usr/lib64 --exec-prefix=/ [[BR]]
    294 rock@fly:~> make -j 4 [[BR]]
    295 rock@fly:~> sudo make install [[BR]]
    296 # libdrm.so will be installed to /usr/lib64 [[BR]]
    297192
    298193rock@fly:~> sudo vim /etc/X11/fs/config  [[BR]]
    … …  
    58548038320 frames in 5.0 seconds = 7663.902 FPS
    58648138317 frames in 5.0 seconds = 7663.308 FPS
    587 38320 frames in 5.0 seconds = 7663.936 FPS
    588 38329 frames in 5.0 seconds = 7665.636 FPS
    589 38316 frames in 5.0 seconds = 7663.152 FPS
    590 38307 frames in 5.0 seconds = 7661.244 FPS
    591 38321 frames in 5.0 seconds = 7664.146 FPS
    592 38308 frames in 5.0 seconds = 7661.435 FPS
    593 38310 frames in 5.0 seconds = 7661.956 FPS
    594 38323 frames in 5.0 seconds = 7664.566 FPS
    595 38311 frames in 5.0 seconds = 7662.112 FPS
    596 38306 frames in 5.0 seconds = 7661.194 FPS
    597 38318 frames in 5.0 seconds = 7663.445 FPS
    598 38320 frames in 5.0 seconds = 7663.884 FPS
    599 38310 frames in 5.0 seconds = 7661.989 FPS
    600 38325 frames in 5.0 seconds = 7664.809 FPS
    601 38317 frames in 5.0 seconds = 7663.257 FPS
    602 38308 frames in 5.0 seconds = 7661.587 FPS
    603 38318 frames in 5.0 seconds = 7663.428 FPS
    604 38305 frames in 5.0 seconds = 7660.958 FPS
    605 38317 frames in 5.0 seconds = 7663.250 FPS
    606 38327 frames in 5.0 seconds = 7665.265 FPS
    607 38313 frames in 5.0 seconds = 7662.488 FPS
    608 38311 frames in 5.0 seconds = 7662.028 FPS
    609 38317 frames in 5.0 seconds = 7663.277 FPS
    610 38313 frames in 5.0 seconds = 7662.439 FPS
    611 38314 frames in 5.0 seconds = 7662.786 FPS
    612 38325 frames in 5.0 seconds = 7664.986 FPS
    613 38311 frames in 5.0 seconds = 7662.035 FPS
    614 38304 frames in 5.0 seconds = 7660.689 FPS
    615 38333 frames in 5.0 seconds = 7666.563 FPS
    616 38309 frames in 5.0 seconds = 7661.684 FPS
    617 38311 frames in 5.0 seconds = 7662.048 FPS
    618 38330 frames in 5.0 seconds = 7665.816 FPS
    619 38316 frames in 5.0 seconds = 7663.065 FPS
    620 38306 frames in 5.0 seconds = 7661.012 FPS
    621 38022 frames in 5.0 seconds = 7604.208 FPS
    622 38030 frames in 5.0 seconds = 7605.954 FPS
    623 38020 frames in 5.0 seconds = 7603.871 FPS
    624 38027 frames in 5.0 seconds = 7605.272 FPS
    625 38023 frames in 5.0 seconds = 7604.425 FPS
    626 38028 frames in 5.0 seconds = 7605.428 FPS
    627 38032 frames in 5.0 seconds = 7606.298 FPS
    628 38008 frames in 5.0 seconds = 7601.419 FPS
    629 38032 frames in 5.0 seconds = 7606.386 FPS
    630 38034 frames in 5.0 seconds = 7606.672 FPS
    631 38029 frames in 5.0 seconds = 7605.690 FPS
    632482}}}
    633483
    634484Average Score: 7630 FPS [[BR]]
    635485
    636 == 11.Lustre Storage Cluster for 3D Fly platform Performance (I/O Benchmark without Ethernet Bonding) ==
    637 
    638 == Testbed Information ==
    639  * Server
    640 ||CPU ||Intel(R) Core(TM)2 Quad CPU    Q6600  @ 2.40GHz ||
    641 ||Memory ||2GB DDR2 667||
    642 ||Disk  ||sda:160G sdb:320G||
    643 ||Graphic || NVIDIA GeForce 7300GT 256MB DDR2 X1 PCI-E 16X
    644 ||NIC ||Intel Corporation 82566DM Gigabit Network Connection||
    645 
    646 
    647 ||Switch ||D-link 24 port GE switch||
    648 [[BR]]
    649  * Clients
    650 ||Node number||7 nodes||
    651 ||CPU ||Intel(R) Core(TM)2 Quad CPU    Q6600  @ 2.40GHz (each node)||
    652 ||Memory ||2GB DDR2 667 (each node)||
    653 ||Disk  ||sda:160G sdb:320G||
    654 ||NIC ||Intel Corporation 82566DM Gigabit Network Connection||
    655 ||Switch ||D-link 24 port GE switch||
    656 [[BR]]
    657  * Software Information
    658 ||OS||openSUSE 10.3 Linux with kernel 2.6.22 x86_64 ||
    659 ||Cluster Environment||DRBL||
    660 ||3D Modol tools||Amira4.1.1||
    661 [[BR]]
    662 
    663 == Usage Note ==
     486== 11. Intel Corporation 82Q963/Q965 Integrated Graphics Driver & Setting ==
     487
     488rock@fly:~> sudo vim /etc/sysconfig/displaymanager [[BR]]
     489
     490{{{
     491## Type:        string(Xorg,Xgl)
     492## Path:        Desktop/Display manager
     493## Default:     "Xorg"
     494#
     495# Xgl is an experimental Xserver using OpenGL for rendering
     496# Right now only the glx backend is supported, which runs on top of a
     497# standard Xorg server providing OpenGL.
     498# Set this to 'Xgl' and run SuSEconfig only if you want to run your
     499# displaymanager (kdm/gdm/xdm) on Xgl on top of Xorg.
     500# This setting is case sensitive.
     501# Warning! This is highly experimental.
     502
     503## If we use Xgl setting to run gdm, we no longer get 3D Direct Rendering but rather software rendering. XGL still gives you 3D but not through Direct Rendering. To get the git for the latest Xorg may solve this bug. (Dependency: Current-> libdrm-2.3.0) 
     504
     505DISPLAYMANAGER_XSERVER="Xorg"
     506DISPLAYMANAGER_XGL_OPTS="-accel glx:pbuffer -accel xv:pbuffer"
     507DISPLAYMANAGER="gdm"
     508DISPLAYMANAGER_REMOTE_ACCESS="yes"
     509DISPLAYMANAGER_ROOT_LOGIN_REMOTE="yes"
     510DISPLAYMANAGER_STARTS_XSERVER="yes"
     511}}}
     512
     513=== X.org driver ===
     514{{{
     515rock@fly:~> git-clone git://anongit.freedesktop.org/git/xorg/driver/xf86-video-intel
     516}}}
     517
     518=== Mesa 3D GL Driver ===
     519# Chip: Intel Corporation 82Q963/Q965 Integrated Graphics [[BR]]
     520# Update Mesa-7.0.1 (Current) -> Mesa-7.0.4 (Last Stable release)  [[BR]]
     521# rock@fly:~> git-clone git://anongit.freedesktop.org/git/mesa/mesa (The latest Mesa 7.1.0 -> Dependency -> libdrm-2.3.1 higher! Do not fit current system ) [[BR]]
     522rock@fly:~> wget http://downloads.sourceforge.net/mesa3d/MesaLib-7.0.4.tar.gz?modtime=1218883994&big_mirror=0 (Mesa 7.0.4 -> Dependency -> libdrm-2.3.0) [[BR]]
     523rock@fly:~> tar zxvf MesaLib-7.0.4.tar.gz [[BR]]
     524rock@fly:~> cd ./Mesa-7.0.4/ [[BR]]
     525rock@fly:~> make linux-dri-x86-64 -j 4 [[BR]]
     526rock@fly:~> sudo make install (Default PATH:/usr/local/lib64/) [[BR]]
     527rock@fly:~> ldd /usr/bin/glxinfo [[BR]]
     528        '''libGLU.so.1 => /usr/lib64/libGLU.so.1 (0x00002b0473cee000)''' ---> Mesa library [[BR]]
     529        '''libGL.so.1 => /usr/lib64/libGL.so.1 (0x00002b0473f5a000)'''   ---> Mesa library [[BR]]
     530        libXext.so.6 => /usr/lib64/libXext.so.6 (0x00002b04741d6000) [[BR]]
     531        libX11.so.6 => /usr/lib64/libX11.so.6 (0x00002b04743e8000) [[BR]]
     532        libpthread.so.0 => /lib64/libpthread.so.0 (0x00002b047471e000) [[BR]]
     533        libm.so.6 => /lib64/libm.so.6 (0x00002b0474939000) [[BR]]
     534        libc.so.6 => /lib64/libc.so.6 (0x00002b0474b8d000) [[BR]]
     535        libstdc++.so.6 => /usr/lib64/libstdc++.so.6 (0x00002b0474ed2000) [[BR]]
     536        libgcc_s.so.1 => /lib64/libgcc_s.so.1 (0x00002b04751da000) [[BR]]
     537        libXxf86vm.so.1 => /usr/lib64/libXxf86vm.so.1 (0x00002b04753e9000) [[BR]]
     538        libXdamage.so.1 => /usr/lib64/libXdamage.so.1 (0x00002b04755ef000) [[BR]]
     539        libXfixes.so.3 => /usr/lib64/libXfixes.so.3 (0x00002b04757f2000) [[BR]]
     540        libdl.so.2 => /lib64/libdl.so.2 (0x00002b04759f9000) [[BR]]
     541        libdrm.so.2 => /usr/lib64/libdrm.so.2 (0x00002b0475bfd000) [[BR]]
     542        libXau.so.6 => /usr/lib64/libXau.so.6 (0x00002b0475e08000) [[BR]]
     543        libxcb-xlib.so.0 => /usr/lib64/libxcb-xlib.so.0 (0x00002b047600c000) [[BR]]
     544        libxcb.so.1 => /usr/lib64/libxcb.so.1 (0x00002b047620e000) [[BR]]
     545        /lib64/ld-linux-x86-64.so.2 (0x00002b0473ad1000) [[BR]]
     546rock@fly:~> sudo rm /usr/lib64/libGLU.so libGLU.so.1 libGL.so libGL.so.1 (Remove these old links) [[BR]]
     547rock@fly:~> sudo cp /usr/local/lib64/libGL.so.1.2 /usr/lib64 [[BR]]
     548rock@fly:~> sudo cp /usr/local/lib64/libGLU.so.1.3.070004 /usr/lib64 [[BR]]
     549rock@fly:~> cd /usr/lib64 [[BR]]
     550rock@fly:~> sudo ln -s libGLU.so.1.3.070004 libGLU.so.1 [[BR]]
     551rock@fly:~> sudo ln -s libGLU.so.1 libGLU.so [[BR]]
     552rock@fly:~> sudo ln -s libGL.so.1.2 libGL.so.1 [[BR]]
     553rock@fly:~> sudo ln -s libGL.so.1 libGL.so [[BR]]
     554
     555Sanity Check:
     556rock@fly:~> glxinfo -display :0 ( Direct Rendering )
     557{{{
     558name of display: :0.0
     559display: :0  screen: 0
     560direct rendering: Yes
     561server glx vendor string: SGI
     562server glx version string: 1.2
     563OpenGL vendor string: Tungsten Graphics, Inc
     564OpenGL renderer string: Mesa DRI Intel(R) 965Q 4.1.3002
     565OpenGL version string: 1.4 Mesa 7.0.4
     566}}}
     567rock@fly:~> glxgears -display :0 ( Frame Test )
     568
     569=== DRM Kernel module - For libdrm ===
     570# Update to the latest libdrm [[BR]]
     571rock@fly:~> git-clone git://anongit.freedesktop.org/git/mesa/drm [[BR]]
     572rock@fly:~> cd ./drm [[BR]]
     573rock@fly:~> ./autogen.sh --prefix=/usr/lib64 --exec-prefix=/ [[BR]]
     574rock@fly:~> make -j 4 [[BR]]
     575rock@fly:~> sudo make install [[BR]]
     576# libdrm.so will be installed to /usr/lib64 [[BR]]
     577
     578== 12. Usage Note ==
    664579@Client [[BR]]
    665580rider@350z:~$ ssh rock@gtd-fly server [[BR]]