Naive Bayes:

Simple and effective common classification algorithm , Typical use : Spam classification

hypothesis : Given the target value, the attributes are conditionally independent of each other

Again , The Bayesian estimate of a priori probability is

advantage :

1、 One kind of unsupervised learning , Implement a simple , No iterations , High learning efficiency , It will have better performance in large sample size .

2、 There is a relatively simple explanation for the learning of classifiers , The classification principle can be understood simply through some probability values calculated during query learning .

shortcoming :

1、 The assumption is too strong —— Suppose that the characteristic conditions are independent , It is not applicable in the scene where the characteristic conditions of the input vector are related .

#################################Weka###############################

 

######################R Language ##################################

##########klaR In bag NaiveBayes function , Because this function adds two functions to the former , One is that you can input a priori probability , The other is to add the kernel smooth density function to the normal distribution ###################

library(klaR)

data(iris)

mN <- NaiveBayes(Species ~ ., data = iris)

plot(mN)

Naive Bayes More articles on theory and practice

  1. MLLib practice Naive Bayes

    introduction This article is based on Spark (1.5.0) ml Library provides the pipeline A complete practice of text classification .pipeline Split the concatenated words (tokenize). Word frequency statistics (TF), Eigenvector calculation (TF-IDF), Park ...

  2. Ten classic algorithms of data mining (9) Naive Bayes classifier Naive Bayes

    Bayesian classifier The classification principle of Bayesian classifier is based on the prior probability of an object , Use Bayesian formula to calculate the posterior probability , That is, the probability that the object belongs to a certain class , The class with maximum a posteriori probability is selected as the class to which the object belongs . At present, there are mainly four kinds of Bayesian classifiers , ...

  3. Ten classic data mining algorithms (9) Naive Bayes classifier Naive Bayes

    Bayesian classifier Bayesian classification principle is a priori probability of an object passing through . Bayesian posterior probability formula is used to calculate the posterior probability , in other words , The probability that the object belongs to a class . The class with the maximum a posteriori probability is selected as the class of the object . Now more research on Bayesian classifiers , There are four , Every room :N ...

  4. Naive Bayes (NB Model) First time to know

    1,Bayes Theorem P(A,B)=P(A|B)P(B); P(A,B)=P(B|A)P(A); P(A|B)=P(B|A)P(A)/P(B);     The Bayes theorem is a distortion 2, Probability graph model 2.1   Definition General ...

  5. PGM: Naive Bayesian model represented by Bayesian network naive Bayes

    http://blog.csdn.net/pipisorry/article/details/52469064 The use of independence Conditional parameterization and conditional independence hypothesis are combined , The aim is to produce a very compact high dimensional probability distribution ...

  6. [ machine learning ] classification --- Naive Bayes( Naive Bayes )

    Naive Bayes- Naive Bayes Bayes' theorem( Bayes' rule ) In probability and Statistics ,Bayes' theorem( Bayes' rule ) Describe the probability of an event according to its prior knowledge . The expression of Bayesian law is as follows ...

  7. R be based on Bayes The theory realizes the gender determination of Chinese personnel characteristics

    See   Gender determination method based on Chinese personnel characteristics   theory , Tell me a name , Let's guess if it's a man or a woman , A little bit of fortune telling . This proposition is a supervised learning method , Learn a prediction model from labeled training data , Then the unlabeled data is predicted . 1 ...

  8. be based on Naive Bayes Algorithm for text classification

    theory What is naive Bayes algorithm ? Naive Bayes classifier is a weak classifier based on Bayes theorem , All naive Bayes classifiers assume that each feature of the sample is uncorrelated with other features . for instance , If a fruit has red color , round , The diameter is about 3 Inch and so on , The fruit ...

  9. Python Machine learning algorithm — Naive bayes algorithm (Naive Bayes)

    Naive bayes algorithm -- brief introduction Naive bayes method is a classification method based on bayes theorem and independent hypothesis of feature conditions . The two most widely used classification models are decision tree model (Decision Tree Model) And naive Bayesian models (Naive Baye ...

Random recommendation

  1. Agile meets UML—— The year of the horse conference of soft innovation base ( ShenZhen Railway Station 2014-3-15)

    Invitation : Dear sir : We will offer you a high-end knowledge dinner in Shenzhen , When agile meets UML, What kind of chemical action will happen ? Chief expert Mr. Zhang will share with you the best practice of requirement analysis and software design , Help you master agility .UML And a combination of the two ...

  2. iOS Delete the configured class library and remove CocoaPods

    introduction We use CocoaPods Import some third-party class libraries into our project very efficiently , But I can't help but have a question : If a class library is not applicable , Even the whole CocoaPods We don't want to hold any more in the project , So how do we put these ...

  3. A penalty for yourself -PHP Basics ( One )

    hi Lazy cancer is the most terrible cancer , As we approach our own year , Set yourself a few routine things you must do every day , No more pigeons !! php It's something I've been learning , But I always thought php Simple , The difficulty lies in mastering a lot of relevant knowledge , It's not exactly right ,php ...

  4. Oracle Learning Series 3

    Oracle Learning Series 3 ************************************************************************************ Multi table search ...

  5. git Create branches and submit projects

    git Create a branch , Switch branches , Merging branches , Delete branches and submit [commit Submit to the local repository push Vanity submit to remote server ], Check out the [pull], Conflict modification , The local warehouse synchronizes the remote server [pul and push command l] ...

  6. Regular Expressions in Grep Command with 10 Examples --reference

    Regular expressions are used to search and manipulate the text, based on the patterns. Most of the L ...

  7. 8.2.1.15 ORDER BY Optimization ORDER BY Optimize

    8.2.1.15 ORDER BY Optimization ORDER BY Optimize In some cases , MySQL You can use an index to satisfy a ORDER BY Clause does not need to do extra sorting index It can be used ...

  8. Writable computing monitor (Writable computed observables)

    Novices can ignore this section , Writable dependency monitoring properties are really too advanced 了 , And most of the time it's not used . In general , The value of calculation monitoring is calculated by the value of other monitoring properties , So it's read-only . This seems strange , What can we do to make ...

  9. MySQL Restore only a library or a table

    stay Mysqldump In the official tools , How to restore only one library ? Full database backup [root@HE1 ~]#mysqldump -uroot -p --single-transaction -A --master-da ...

  10. IDA7.0 install keypatch and findcrypt-yara plug-in unit

    IDA7.0 install keypatch and findcrypt-yara plug-in unit Thank goodness it's finally loaded , Write down the method quickly . Looking for a long time online installation method is cumbersome and pitfalls , But this plug-in uses keystone There's a high demand for versions . Keyp ...