VPN & Ubuntu

My network pauses was resolved, and it seems to be the NetworkManager
not using the madwifi driver.

In this case, following in daemon.log are used
"blah....NetworkManager: Supplicant state changed 0" // when pausing
"blah....NetworkManager: Supplicant state changed 1" // on resume

The solution is to use "wicd", which works perfectly with the madwifi/atheros driver.
The directions are here
http://wicd.sourceforge.net/download.php.

Q-learning vs Model-based or knowledge-based Methods

1. Learn action-value representation -- Q value instead of learning utility
2. Denote Q-values related to utility values
3. Q function is a way of utility function, but Q function does not need a model for learning action selection. So it is model free since temporal difference does not need to know transition model but only handle the changes. How to deal with the things are no-change. It is a frame problem.
4. Agent function (an evaluation function) is represented by Q function instead of model + utility function
5. Traditional AI is to build knowledge-based method (build a representation of some aspect of the environment in which agent is situated).
6. environment becomes complex, the advantages of a knowledge-based approach become more apparent. Knowledge-based model representation has met more success than Q-learning methods

zpool iostat -v ------------------ df-kh

zpool iostat -v is much more intuitive than df -h

Transform Discontinuous Function into Differentiable Function

A discrete independent variable leads to a discontinuous function. A infinitesimal change in the independent variable causes the dependent variable to switch from one variable to another. This means that the value of the policy may also change discontinuously, which makes gradient-based search difficult.

Softmax function : transform from a discontinuous function into differentiable function

CERN LHC & Storage with Data Management

http://gridcafe.web.cern.ch/gridcafe/animations/LHCdata/LHCdata.html


It is an amazing new age of science. It claimed 20 petabyte by
annual basis. Large storage and data management practices.

DS 6.x instance configuration

To configure 3 instances of DS, created on different host, (different IP and the same port)

under the same domain. With DSEE 6.x, it is possible to create and configure instances on those machines from the Directory Service Control Center (i.e. DSEE 6 Console).

Mobile Data Management and Mobile Agent

    * Data management in wireless networks
   * Data management in sensor and mobile ad hoc networks
   * Data management in mobile peer-to-peer networks
   * Data mining for mobile applications
   * Data presentation, scripting and exchange languages
   * Data replication, migration and dissemination in mobile environments
   * Data stream processing in mobile/sensor networks
   * Indexing and query processing for moving objects
   * Location and mobility semantics
   * Location tracking of vehicles and moving objects
   * Metadata management and exchanges
   * Mobile access to the Web
   * Mobile agents


A conference: Mobile Data Mangement (MDM'09): Systems, Services and Middleware