Science, Philosophy and Religion(Einstein)

It would not be difficult to come to an agreement as to what we understand by science. Science is the century-old endeavor to bring together by means of systematic thought the perceptible phenomena of this world into as thoroughgoing an association as possible. To put it boldly, it is the attempt at the posterior reconstruction of existence by the process of conceptualization. But when asking myself what religion is I cannot think of the answer so easily. And even after finding an answer which may satisfy me at this particular moment, I still remain convinced that I can never under any circumstances bring together, even to a slight extent, the thoughts of all those who have given this question serious consideration.

At first, then, instead of asking what religion is I should prefer to ask what characterizes the aspirations of a person who gives me the impression of being religious: a person who is religiously enlightened appears to me to be one who has, to the best of his ability, liberated himself from the fetters of his selfish desires and is preoccupied with thoughts, feelings, and aspirations to which he clings because of their superpersonalvalue. It seems to me that what is important is the force of this superpersonal content and the depth of the conviction concerning its overpowering meaningfulness, regardless of whether any attempt is made to unite this content with a divine Being, for otherwise it would not be possible to count Buddha and Spinoza as religious personalities. Accordingly, a religious person is devout in the sense that he has no doubt of the significance and loftiness of those superpersonal objects and goals which neither require nor are capable of rational foundation. They exist with the same necessity and matter-of-factness as he himself. In this sense religion is the age-old endeavor of mankind to become clearly and completely conscious of these values and goals and constantly to strengthen and extend their effect. If one conceives of religion and science according to these definitions then a conflict between them appears impossible. For science can only ascertain what is, but not what should be, and outside of its domain value judgments of all kinds remain necessary. Religion, on the other hand, deals only with evaluations of human thought and action: it cannot justifiably speak of facts and relationships between facts. According to this interpretation the well-known conflicts between religion and science in the past must all be ascribed to a misapprehension of the situation which has been described.

For example, a conflict arises when a religious community insists on the absolute truthfulness of all statements recorded in the Bible. This means an intervention on the part of religion into the sphere of science; this is where the struggle of the Church against the doctrines of Galileo and Darwin belongs. On the other hand, representatives of science have often made an attempt to arrive at fundamental judgments with respect to values and ends on the basis of scientific method, and in this way have set themselves in opposition to religion. These conflicts have all sprung from fatal errors.

Now, even though the realms of religion and science in themselves are clearly marked off from each other, nevertheless there exist between the two strong reciprocal relationships and dependencies. Though religion may be that which determines the goal, it has, nevertheless, learned from science, in the broadest sense, what means will contribute to the attainment of the goals it has set up. But science can only be created by those who are thoroughly imbued with the aspiration toward truth and understanding. This source of feeling, however, springs from the sphere of religion. To this there also belongs the faith in the possibility that the regulations valid for the world of existence are rational, that is, comprehensible to reason. I cannot conceive of a genuine scientist without that profound faith. The situation may be expressed by an image: science without religion is lame, religion without science is blind.

Though I have asserted above that in truth a legitimate conflict between religion and science cannot exist, I must nevertheless qualify this assertion once again on an essential point, with reference to the actual content of historical religions. This qualification has to do with the concept of God. During the youthful period of mankind's spiritual evolution human fantasy created gods in man's own image, who, by the operations of their will were supposed to determine, or at any rate to influence, the phenomenal world. Man sought to alter the disposition of these gods in his own favor by means of magic and prayer. The idea of God in the religions taught at present is a sublimation of that old concept of the gods. Its anthropomorphic character is shown, for instance, by the fact that men appeal to the Divine Being in prayers and plead for the fulfillment of their wishes.

Nobody, certainly, will deny that the idea of the existence of an omnipotent, just, and omnibeneficent personal God is able to accord man solace, help, and guidance; also, by virtue of its simplicity it is accessible to the most undeveloped mind. But, on the other hand, there are decisive weaknesses attached to this idea in itself, which have been painfully felt since the beginning of history. That is, if this being is omnipotent, then every occurrence, including every human action, every human thought, and every human feeling and aspiration is also His work; how is it possible to think of holding men responsible for their deeds and thoughts before such an almighty Being? In giving out punishment and rewards He would to a certain extent be passing judgment on Himself. How can this be combined with the goodness and righteousness ascribed to Him?

The main source of the present-day conflicts between the spheres of religion and of science lies in this concept of a personal God. It is the aim of science to establish general rules which determine the reciprocal connection of objects and events in time and space. For these rules, or laws of nature, absolutely general validity is required--not proven. It is mainly a program, and faith in the possibility of its accomplishment in principle is only founded on partial successes. But hardly anyone could be found who would deny these partial successes and ascribe them to human self-deception. The fact that on the basis of such laws we are able to predict the temporal behavior of phenomena in certain domains with great precision and certainty is deeply embedded in the consciousness of the modern man, even though he may have grasped very little of the contents of those laws. He need only consider that planetary courses within the solar system may be calculated in advance with great exactitude on the basis of a limited number of simple laws. In a similar way, though not with the same precision, it is possible to calculate in advance the mode of operation of an electric motor, a transmission system, or of a wireless apparatus, even when dealing with a novel development.

To be sure, when the number of factors coming into play in a phenomenological complex is too large, scientific method in most cases fails us. One need only think of the weather, in which case prediction even for a few days ahead is impossible. Nevertheless no one doubts that we are confronted with a causal connection whose causal components are in the main known to us. Occurrences in this domain are beyond the reach of exact prediction because of the variety of factors in operation, not because of any lack of order in nature.

We have penetrated far less deeply into the regularities obtaining within the realm of living things, but deeply enough nevertheless to sense at least the rule of fixed necessity. One need only think of the systematic order in heredity, and in the effect of poisons, as for instance alcohol, on the behavior of organic beings. What is still lacking here is a grasp of connections of profound generality, but not a knowledge of order in itself.

The more a man is imbued with the ordered regularity of all events the firmer becomes his conviction that there is no room left by the side of this ordered regularity for causes of a different nature. For him neither the rule of human nor the rule of divine will exists as an independent cause of natural events. To be sure, the doctrine of a personal God interfering with natural events could never be refuted, in the real sense, by science, for this doctrine can always take refuge in those domains in which scientific knowledge has not yet been able to set foot.

But I am persuaded that such behavior on the part of the representatives of religion would not only be unworthy but also fatal. For a doctrine which is able to maintain itself not in clear light but only in the dark, will of necessity lose its effect on mankind, with incalculable harm to human progress. In their struggle for the ethical good, teachers of religion must have the stature to give up the doctrine of a personal God, that is, give up that source of fear and hope which in the past placed such vast power in the hands of priests. In their labors they will have to avail themselves of those forces which are capable of cultivating the Good, the True, and the Beautiful in humanity itself. This is, to be sure, a more difficult but an incomparably more worthy task. (This thought is convincingly presented in Herbert Samuel's book, Belief and Action.) After religious teachers accomplish the refining process indicated they will surely recognize with joy that true religion has been ennobled and made more profound by scientific knowledge.

If it is one of the goals of religion to liberate mankind as far as possible from the bondage of egocentric cravings, desires, and fears, scientific reasoning can aid religion in yet another sense. Although it is true that it is the goal of science to discover rules which permit the association and foretelling of facts, this is not its only aim. It also seeks to reduce the connections discovered to the smallest possible number of mutually independent conceptual elements. It is in this striving after the rational unification of the manifold that it encounters its greatest successes, even though it is precisely this attempt which causes it to run the greatest risk of falling a prey to illusions. But whoever has undergone the intense experience of successful advances made in this domain is moved by profound reverence for the rationality made manifest in existence. By way of the understanding he achieves a far-reaching emancipation from the shackles of personal hopes and desires, and thereby attains that humble attitude of mind toward the grandeur of reason incarnate in existence, and which, in its profoundest depths, is inaccessible to man. This attitude, however, appears to me to be religious, in the highest sense of the word. And so it seems to me that science not only purifies the religious impulse of the dross of its anthropomorphism but also contributes to a religious spiritualization of our understanding of life.

The further the spiritual evolution of mankind advances, the more certain it seems to me that the path to genuine religiosity does not lie through the fear of life, and the fear of death, and blind faith, but through striving after rational knowledge. In this sense I believe that the priest must become a teacher if he wishes to do justice to his lofty educational mission.
(published by the Conference on Science, Philosophy and Religion in Their Relation to the Democratic Way of Life, Inc., New York, 1941.)

最近对一个数据做预处理，上万的实例，用工具处理起来还是遇到了一些小麻烦，在...

最近对一个数据做预处理，上万的实例，用工具处理起来还是遇到了一些小麻烦，在此总结一下解决方案。
与处理中遇到的三个基本问题：数据缺失值处理，噪点处理以及归一化处理。
缺失值处理：
找了四个工具weka,matlab,excel,spss.结果发现matlab,weka和spss有直接处理缺失值的方法。
matlab:
matlab提供了一个的fixunknowns()函数处理缺失值。例子：
x1 = [1 2 3 4; 4 NaN 6 5; NaN 2 3 NaN]
[y1,ps] = fixunknowns(x1)
结果如图所示：

进一步的信息

下面是一个缺失值填充的一个matlab函数:
function [y]=ReplaceMissingValue(x,type,value)

%%
%input:
% x:n*d;n denote the number of samples,d:denote dimenssion
% type:
% 1：replace the NaN with the value;
% 2：replace the NaN with the mean, in this case, value is options;
% when the type is default,it would be set 2;
%value: which use to replace the NaN
%%output:
% name: 'fixunknowns'
%       xrows: 3
%       yrows: 5
%     unknown: [2 3]
%       known: 1
%       shift: [0 0 1]
%      xmeans: [3x1 double]


if nargin <2
    type=2;
end
if nargin <3 && type==1
    disp('pleaes assign a "value" using to replace');
    return;
end

if type==2
    [tempy,tempps]=fixunknowns(x');


    %计算空缺值所在行的全部索引
    indexaux=zeros(tempps.yrows,1);
    numNaN=size(tempps.unknown,2);
    indexaux(tempps.unknown'+(1:numNaN)')=1;
    indexaux=~indexaux;

    %计算修补后的矩阵
    rows=1:tempps.yrows;
    rows=rows';
    index=indexaux.*rows;
    y=tempy(find(index>0),:)';

end
if type==1
    nan=isnan(x);
    notnan=~nan;
    indexnotnan=find(double(notnan)==1);
    notan1=zeros(size(x));
    notan1(indexnotnan)=x(indexnotnan);
    y=notan1+nan*value;
    
end

weka:在filter->unsupervised->attribute->ReplaceMissingValues，其对缺失值处理只有一种方法，即modes and means.

而spss则要强大多了，其对缺失值的处理有好几种方法，Transform->Replace missing values;

matlab 和excel 也可以使用编程的方法或者其他处理方法来解决missing  value 的问题，但是相对来说还是没有那么的方便。

数据归一化：
 方法很多，最为常用的方法之一是：z-score，即 means=0,std=1，这种方法spss,和matlab都有提供，spss如图所示：

matlab使用的函数为：mapstd(data,means,std)，具体使用参考matlab （注意，data:d*n,d 表示维度，n表示样本数） .
如图所示：（x1为下面mapminmax中的x1）

还有一个方法即是归一化到一个区间，如[a,b]，此种方法都很简单大多都基于以下原理： y = (ymax-ymin)*(x-xmin)/(xmax-xmin) + ymin;,在matlab中有函数：mapminmax（data）,具体使用参考matlab （注意，data:d*n,d 表示维度，n表示样本数）.
如图所示：

噪音点处理：

一个简单方法是：对于连续变量，可以使用z-score归一化数据，然后对 值大于3小于-3的单元所在的样本视为噪音。对于分类变量，由于每个值都有相应意义的，故对于偏离取值范围的值即可视为噪点。噪点可以剔除也可以将其作为缺失值处理。spss和excel就可以提供这样的简单处理。

web proxy访问我的blogspot

博客被封了，一直没有来维护，也一直挂着，最近找了一个还不错的web代理网站，居然可以访问被封已久的blogger，速度还是可以的。令人兴奋。the address is showed as follow:http://www.sneakme.net/

Multiple kernel learning's People

1.Gert Lanckriet----- Homepage

My research interests are on the interplay between machine learning, applied statistics and convex optimization techniques. I am interested in developing methods for pattern discovery from extremely large-scale data sets, taking uncertainty into account and respecting computational constraints. More precisely, my research focuses on the integration of multiple, heterogeneous data types for a variety of pattern discovery tasks where the amount of data is extremely large and the solutions desired to be sparse. An important challenge in the field of machine learning is to deal with the increasing amount of data that is available for learning and to leverage the (also increasing) diversity of information sources, describing these data. Beyond classical vectorial data formats, data in the format of graphs, trees, strings and beyond have become widely available for data mining, e.g., the linked structure of communication networks, amino acid sequences describing proteins, etc. Moreover, for interpretability, stability and economical reasons, decision rules that rely on a small subset of the information sources and/or a small subset of the features describing the data are highly desired: sparse learning algorithms are a must. My research is inspired by practical applications in computational genomics, financial engineering and computer music.

publication:

Lanckriet, G.R.G., Cristianini, N., Bartlett, P., El Ghaoui, L., Jordan, M.I. (2004).Learning the Kernel Matrix with Semidefinite Programming . Journal of Machine Learning Research, 5, 27-72, 2004.

2.Francis Bach-----homepage

I am a researcher at INRIA, working in the Willow project, which is located at Ecole Normale Superieure. I completed my Ph.D. in Computer Science at U.C. Berkeley, working with Professor Michael Jordan, and spent two years in the Mathematical Morphology group at Ecole des Mines de Paris. I am interested in statistical machine learning, and especially in graphical models, sparse methods, kernel-based learning, vision and signal processing. [CV (English)] [CV (French)]

publication:

F. Bach, G. R. G. Lanckriet, M. I. Jordan. Multiple Kernel Learning, Conic Duality, and the SMO Algorithm. Proceedings of the Twenty-first International Conference on Machine Learning, 2004 [pdf] [tech-report]

3.Alain Rakotomamonjy----Homepage

Research Interests
Kernel Methods and Support Vector Machines Algorithm
Regularization paths Multiple Kernel
Kernel Design Sparsity and variable selection Wavelet and Time-Frequency Signal AnalysisSignal Classification Brain-Computer Interfaces  Object Recognition

publication:

A. Rakotomamonjy, F. Bach, Y. Grandvalet, S. Canu, SimpleMKL,  Journal of Machine Learning Research, Vol. 9, pp 2491-2521, 2008. [JMLR page][PDF] [code]

4.M. Gönen----Homepage

Research Interests
Support Vector MachinesKernel MethodsSimulation and Real-time Control of Flexible Manufacturing Systems

publication:

M. Gönen and E. Alpaydın (2008) ”Localized Multiple Kernel Learning”, In Proceedings of the 25th International Conference on Machine Learning, 352-359.

5.S. Sonnenburg----Homepage

I am currently a postdoc at the Machine Learning in Biology Group at the Friedrich Miescher Laboratory of the Max Planck Society in Tübingen. I have been working in the IDA group at the Fraunhofer Institute FIRST.

I am intrigued by sequence based machine learning methods involving large data sets and have developed several machine learning methods for bioinformatics applications such as splice site recognition, promoter detection and gene finding. I also worked on microarray analysis and motif discovery.

publication:

S. Sonnenburg, G. R¨atsch, C. Sch¨afer, and B. Sch¨olkopf. Large scale multiplekernel learning. Journal of Machine Learning Research, 7, 2006.

how to use CRF++

in recently ,i learned the CRF for information extraction ,studyed its theory and  collected the CRF tools.first of all,i get the information of CRF from wiki websit where have so many CRF resource,including theory ,people who are studying ,offering a lot of valid papers links,

References

• Lafferty, J., McCallum, A., Pereira, F.: Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In: Proc. 18th International Conf. on Machine Learning, Morgan Kaufmann, San Francisco, CA (2001) 282–289
• McCallum, A.: Efficiently inducing features of conditional random fields. In: Proc. 19th Conference on Uncertainty in Artificial Intelligence. (2003)
• Sha, F., Pereira, F.: Shallow parsing with conditional random fields. Technical Report MS-CIS-02-35, University of Pennsylvania (2003)
• Wallach, H.M.: Conditional random fields: An introduction. Technical Report MS-CIS-04-21, University of Pennsylvania (2004)
• Sutton, C., McCallum, A.: An Introduction to Conditional Random Fields for Relational Learning. In "Introduction to Statistical Relational Learning". Edited by Lise Getoor and Ben Taskar. MIT Press. (2006)
• Klinger, R., Tomanek, K.: Classical Probabilistic Models and Conditional Random Fields. Algorithm Engineering Report TR07-2-013, Department of Computer Science, Dortmund University of Technology, December 2007. ISSN 1864-4503. Online PDF

what the most importance thing  is the there  are a good many CRF tools.The listed tools is the most popular tools for using.   

Software

This is a partial list of software that implement CRF related tools.

• MALLET (Java)
• ABNER (Java)
• MinorThird (Java)
• Kevin Murphy's MATLAB CRF code (Matlab)
• Sunita Sarawagi's CRF package (Java)
• HCRF library (including CRF and LDCRF) (C++, Matlab)
• CRFSuite Fast CRF implementation (C++)
• Xcrf for Xml data (Java)
• CRF++ (C++)
• sgd: An LGPL C++ library implementing Stochastic Gradient Descent with application to learning CRF andSupport Vector Machine
• FlexCRFs (including a parallel implementation) (C++)

I choose the CRF++ (C++) for my project.so I take attenttion in how to using this software.

I have been basically understood its usage through several days learning.if you are a beginner ,you can get quick start from its online document .when you using this tool,some note you should attention:

      1.the column of Token must be seperated by space or tab.It imply that the partition word must not include the space or tab.for instance "hello world    NB    1","hello world" is not allowed for including space.

      2.if you want to use the API for your project in MS operating system.you can look the fold:\sdk which tell you how to call the dll .

      3.i found that i can do when using java for my project on ms operating system.so i can but rewrite it, i do not know what is the reason.

数学符号和希腊字母中英文发音列表

序号 大写 小写 英文注音 国际音标注音 中文注音 
1    Α    α    alpha    a:lf       阿尔法 
2    Β    β    beta     bet        贝塔 
3    Γ    γ    gamma    ga:m       伽马 
4    Δ    δ    delta    delt       德尔塔 
5    Ε    ε    epsilon  ep`silon   伊普西龙 
6    Ζ    ζ    zeta     zat        截塔 
7    Η    η    eta      eit        艾塔 
8    Θ    θ    thet     θit        西塔 
9    Ι    ι    iot      aiot       约塔 
10   Κ    κ    kappa    kap        卡帕 
11   Λ    λ    lambda   lambd      兰布达 
12   Μ    μ    mu       mju        缪 
13   Ν    ν    nu       nju        纽 
14   Ξ    ξ    xi       ksi        克西 
15   Ο    ο    omicron  omik`ron   奥密克戎 
16   Π    π    pi       pai        派 
17   Ρ    ρ    rho      rou        肉 
18   Σ    σ    sigma   `sigma      西格马 
19   Τ    τ    tau      tau        套 
20   Υ    υ    upsilon  jup`silon  宇普西龙 
21   Φ    φ    phi      fai        佛爱 
22   Χ    χ    chi      phai       西 
23   Ψ    ψ    psi      psai       普西 
24   Ω    ω    omega    o`miga     欧米伽

1  Α  α  alpha  a:lf  
阿尔法  角度；系数 
2  Β  β  beta  bet  
贝塔  磁通系数；角度；系数 
3  Γ  γ  gamma  ga:m  
伽马  电导系数（小写） 
4  Δ  δ  delta  delt  
德尔塔  变动；密度；屈光度 
5  Ε  ε  epsilon  ep`silon  伊普西龙  对数之基数 
6  Ζ  ζ  zeta  zat  
截塔  系数；方位角；阻抗；相对粘度；原子序数 
7  Η  η  eta  eit  
艾塔  磁滞系数；效率（小写） 
8  Θ  θ  thet  
θit  
西塔  温度；相位角 
9  Ι  ι  iot  
aiot  
约塔  微小，一点儿 
10  Κ  κ  kappa  kap  
卡帕  介质常数 
11  ∧  λ  lambda  lambd  
兰布达  波长（小写）；体积 
12  Μ  μ  mu  mju  缪  磁导系数；微（千分之一）；放大因数（小写） 
13  Ν  ν  nu  nju  纽  磁阻系数 
14  Ξ  ξ  xi  ksi  克西  　 
15  Ο  ο  omicron  omik`ron  奥密克戎  　 
16  ∏  π  pi  pai  派  圆周率=圆周÷直径=3.14159 26535 89793 
17  Ρ  ρ  rho  rou  肉  电阻系数（小写） 
18  ∑  σ  sigma  `sigma  西格马  总和（大写），表面密度；跨导（小写） 
19  Τ  τ  tau  tau  套  时间常数 
20  Υ  υ  upsilon  jup`silon  宇普西龙  位移 
21  Φ  φ  phi  fai  佛爱  磁通；角 
22  Χ  χ  chi  phai  西    
23  Ψ  ψ  psi  psai  普西  角速；介质电通量（静电力线）；角 
24  Ω  ω  omega  o`miga  欧米伽  欧姆（大写）；角速（小写）；角 

How to write and add your own algorithm to Weka

Recently，I am studying the weka .My  purpose is that add my own algorithm to Weka.

  

I have collected some resource about these aspects from Weka website。 The links show as follow：

1. Frequently Asked Questions

        In this webpage,it list many frequently asked questions by two catalogue：uing weka and developing weka。

       2.How to write a new classifier to weka

Due to siginificant changes in the API beyond version 3.5.2, there are now two different HOWTOs available.

Please choose the version of Weka you want to develop for:

• <= 3.5.2 (includes 3.4.x)
• > 3.5.2

3.How do I add a new classifier, filter, kernel, etc.?

As of Weka 3.4.4, all the derived classes of superclasses that can be edited in the GenericObjectEditor, like subclasses ofweka.classifiers.Classifier for instance, can be determined dynamically at runtime. Read here for more information.
Note: Weka 3.5.8 turned the automatic discovery off by default.

The GenericObjectEditor is the core component in Weka for modifying schemes, like classifiers and filters in the GUI. It has to be configured correctly in order to show default and additional schemes. See the following articles for more details:

• GenericObjectEditor (book version)
• GenericObjectEditor (developer version)

My Experience：

1.netbean+weka for developing    english and chinese

2.if you want to use the weka3.5.8,due to Weka 3.5.8 turned the automatic discovery off by default.so you must make the adjust:

Automatic class discovery was turned off in 3.5.8. GUIs load faster   

without it turned on and it doesn't work when Weka is loaded as a   
plugin via a custom class loader. However, it is easily re-enabled. Just edit the   
GenericPropertiesCreator.props file (located in weka/gui) and change   
the "UseDynamic" property from "false" to "true". 

3.you can be easy to add a new algorithm to weka.if you are famliar with chinese .the follow website is a good introduction:http://blog.chinaunix.net/u1/34560/showart_269880.html

4.when adding a new algorithm to weka.you may take attention to the problem,namely ,that  your own algorithm can not display in the GUI(i.e  Exprolor) even you have modify the "UseDynamic".For this problem.you should adjust your new package's position,For Instance:you want to add a new package"weka.classifier.cxk".you must configure the GenericPropertiesCreator.props  again:

Original:

weka.classifiers.Classifier=\ 

weka.classifiers.bayes,\ 

weka.classifiers.functions,\

weka.classifiers.lazy,\

weka.classifiers.trees,\ 

weka.classifiers.meta,\

weka.classifiers.cxk,\

 weka.classifiers.rules

Modify

weka.classifiers.Classifier=\ 

weka.classifiers.cxk,\

weka.classifiers.bayes,\ 

weka.classifiers.functions,\

weka.classifiers.lazy,\

weka.classifiers.trees,\ 

weka.classifiers.meta,\

 weka.classifiers.rules