[讨论]看到说feisty运行效率提升-怎么没人讨论Gnu_hash的功劳？

[hyfans]

ubuntuforum也没有啥帖子。

这里也没有。

[skyx]

比下面的資料来看,ubuntu 6.10就用到了。

Ubuntu 6.10 released

* 27th October 2006
* Ashton Mills
* Kernel Knowledge, Linux



Feature highlights can be found here and they include everything that's hip and cool at the moment such as a 2.6.18 based kernel, the latest Gnome 2.16 and KDE 3.5.4, the latest modular Xorg 7.1 and, as is the emerging trend, OpenGL accelerate graphics, this time with AIGLX and Compiz for some impressive visual effects.

Perhaps the most interesting update however is the use of the new GNU_HASH, aka --hash-stye, for dynamic linking. It's interesting because for a while now cutting-edge freaks trying who desperately to break their systems (um, and this includes me) have been playing around with various linker optimisations including -Bdirect, -hashvals, -zdynsort and the rest for over a year now.

All of these linker based optimisations have had various levels of impact on performance, all positive, but so far have been patches against glibc and binutils and not usually included in a distribution (because, quite literally, if you break glibc you break your entire system). the latest development here in GNU_HASH and applied it against the whole system is definitely a boon -- this can dramatically reduce startup times for all applications, whether it's a simple xterm or the behemoth Open Office. See the summary for a full list of new features and these guides here and here for a walkthrough of some of highlights.

Ubuntu 6.10, ala 'Edgy Eft', is a much anticipated update for the Ubuntu series and includes 2.6.17 kernel, the new Gnome 2.16, Open Office 2.0.4, the latest Gaim 2.0 beta, the just-released Firefox 2.0, a new default theme from the Ubuntu art team, and a new init manager called Upstart. Developed specifically for Ubuntu, but available to be used in any distribution, it will be interesting to see if Upstart takes off and becomes the de-facto, much like devfs has now been replaced by udev.

As always, Kbuntu (bundling the very latest KDE 3.5.5), Edubuntu, and Xubuntu have also been updated to the 6.10 release and are available for download.

gnu_hash/prelink related optimizing
use gnu_hash optimisings to reduce dynamic link time

http://www.gentoo.org/doc/en/prelink-howto.xml

Prelink
1. Introduction

What is Prelink and how can it help me?

Most common applications make use of shared libraries. These shared libraries need to be loaded into memory at runtime and the various symbol references need to be resolved. For most small programs this dynamic linking is very quick. But for programs written in C++ and that have many library dependencies, the dynamic linking can take a fair amount of time.

On most systems, libraries are not changed very often and when a program is run, the operations taken to link the program are the same every time. Prelink takes advantage of this by carrying out the linking and storing it in the executable, in effect prelinking it.

Prelinking can cut the startup times of applications. For example, a typical KDE program's loading time can be cut by as much as 50%. The only maintenance required is re-running prelink every time a library is upgraded for a pre-linked executable.

Warning: Prelink will not work with Hardened Gentoo. This is because both projects try to change the address space mapping of shared libraries. But prelink with the -R option randomises library base addresses, providing some degree of hardened protection.

Summary

* Prelinking is done via a program called, surprisingly, prelink. It changes the binary to make it start faster.
* If an application's dependent libraries change after you have prelinked it, you need to re-prelink the application, otherwise you lose the speed advantage. This is to say, everytime you update a package via portage that updates libraries, they need to be re-prelinked.
* The change to the binary is fully reversible. prelink has an undo function.
* Current versions of Portage can handle, via prelink, the changing MD5sums and mtimes of the binaries.
* You do not need to set FEATURES="prelink" in your make.conf file; Portage will automatically support prelink if it can find the prelink binary.

2. Setting up Prelink

Installing the Programs

First you need to install the prelink tool. The emerge process automatically verifies that your system can prelink safely.

Code Listing 2.1: Installing Prelink

# emerge prelink

A number of people get errors in emerging prelink because of the failed tests. The tests were put in for safety reasons, prelink's behavior is undefined if you disable them. The emerge errors are usually only dependent on the core packages; binutils, gcc, and glibc. Try re-emerging those packages in that order.

Note: Tip: If you get an error try compiling and testing prelink yourself (./configure ; make ; make check ). On a failure you can view the *.log files in the testsuite directory. They may provide you with some useful clues.

If you have a set of steps that reproduces the emerge error on another system please check Bugzilla and create a bug report if it has not already been reported.

Preparing your System

Also make sure that you do not have -fPIC set in your CFLAGS/CXXFLAGS. If you do, you will need to rebuild your entire system without.

Configuration

Running env-update will generate the /etc/prelink.conf file that tells prelink which files to prelink.

Code Listing 2.2: Running env-update

# env-update

Unfortunately you cannot prelink files that were compiled by old versions of binutils. Most of these applications come from pre-compiled, binary only packages which are installed in /opt. Making the following file will tell prelink not to attempt to prelink them.

Code Listing 2.3: /etc/env.d/60prelink

PRELINK_PATH_MASK="/opt"

Note: You can add more or less directories to the colon separated list.

3. Prelinking

Prelink Usage

I use the following command to prelink all the binaries in the directories given by /etc/prelink.conf.

Code Listing 3.1: Prelinking listed files

# prelink -amR

Warning: It has been observed that if you are low on disk space and you prelink your entire system then there is a possibility that your binaries may be truncated. The result being a b0rked system. Use the file or readelf command to check the state of a binary file. Alternatively, check the amount of free space on your harddrive ahead of time with df -h.
The options explained:
-a "All": prelinks all the binaries
-m Conserve the virtual memory space. This is needed if you have a lot of libraries that need to be prelinked.
-R Random -- randomize the address ordering, this enhances security against buffer overflows.

Note: For more options and details see man prelink.

Prelink Cron Job

sys-devel/prelink-20060213 and later install a cron job in /etc/cron.daily/prelink. To enable it, edit the configuration file /etc/conf.d/prelink. This will run prelink daily in the background, as needed, saving you running the command manually.

Speeding Up KDE After Prelinking

KDE's loading time can be greatly reduced after prelinking. If you inform KDE that it has been prelinked it will disable the loading of kdeinit (as it isn't required anymore) which speeds up KDE even more.

Set KDE_IS_PRELINKED="true" in /etc/env.d/*kdepaths* to inform KDE about the prelinking.

4. Known Problems and Fixes

"Cannot prelink against non-PIC shared library"

The cause of this problem is from badly compiled shared libraries that were compiled without the -fPIC gcc option for all their object files.

Here are the libraries that haven't been fixed or cannot be fixed:

* The libraries in the wine package, including winex. Prelinking wouldn't speed up MS Windows executables anyway.
* The library in media-video/mjpegtools, /usr/lib/liblavfile-1.6.so.0.
* Nvidia OpenGl libraries, /usr/lib/opengl/nvidia/lib/libGL.so.*. Due to performance reasons they were compiled without PIC support.

If your problem library was not listed please report it with, preferably, a patch to add -fPIC to the relevant CFLAGS.

When I prelink my system some static binaries don't work anymore

Where glibc is concerned, there is no such thing as a 100% static binary. If you statically compile a binary with glibc, it may still depend on other system files. Below is an explanation by Dick Howell,

"I suppose the idea is that everything will be in the downloaded file, so nothing depends on the local libraries on the target system. Unfortunately with Linux, and I think anything else using GLIBC, this still isn't quite true. There's this "libnss" (name service switch, some people seem to call it network security system) which provides functions for accessing various databases for authentication, network information, and other things. It's supposed to make application programs independent of the separately configured actual network environment of the machine. A nice idea, but changes to GLIBC can lead to problems loading it. And you can't statically link "libnss", since it is configured for each machine individually. The problem comes, I think, mainly from statically linking other GLIBC libraries, notably "libpthread", "libm", and "libc", from which come incompatible calls to "libnss" functions."

Prelink aborts with "prelink: dso.c:306: fdopen_dso: Assertion `j == k' failed."

This a known problem, kindly diagnosed here. Prelink cannot cope with UPX-compressed executables. As of prelink-20021213 there is no fix except to hide the executables while you are prelinking. See the Configuration section above for an easy way to do this.

I use grsecurity and it seems that prelinking doesn't work.

In order to prelink on a system with grsecurity using a randomized mmap() base, it is necessary to turn "randomized mmap() base" OFF for /lib/ld-2.3.*.so. This can be done with the chpax utility, but it must be done when the file is not in use (f.i. boot from a rescue CD).

Prelink fails with error "prelink: Can't walk directory tree XXXX: Too many levels of symbolic links"

Your symlinks are nested too deeply. This happens when a symlink points to itself. For example, /usr/lib/lib -> lib is the most common. To fix this, you can find the symlink manually or use the utility provided by the symlinks package:

Code Listing 4.1: Fix symlinks

# emerge symlinks
# symlinks -drv /

More details can be found at Bugzilla and this forum post.

5. Conclusion

Prelinking can drastically speed up the start up times for a number of large applications. Support is built into Portage. Prelinking is also safe as you can always undo the prelinking for any binary if you come across any problems. Just remember that when you update glibc or other libraries that you prelinked with, you need to rerun prelink! In short good luck!

[skyx]

说不定6.06就用到这一特性啦！

[skyx]

最新的ubuntu市场份额非官方统计，由huahua提供线索，下面的图片点击放大

[skyx]

http://www.beijinglug.org/en/index.php? ... sults&id=2

[eexpress]

google趋势都有。谁要这图哦。

[chieftain]

ubuntu发展还是相当的快地

[alteeno]

采样数太少，不值得相信的。

[moxien]

我只知道使用哦，对内核还不是很明白。
至于有哪些技术还是要等牛人说了才明白。