Pages

Thursday, October 29, 2015

My Mother's Letter - Why She Believes in the Gospel of Jesus Christ


My mother, Linda Frye Hartley (pictured here), was once asked by an individual the following: "Do you believe in your faith because of your upbringing? Or do you believe because of your own effort?"

My mother was (and still is) a member of The Church of Jesus Christ of Latter-day Saints (Mormon / LDS). She responded to this question in a letter / email dated February 13, 2004 by explaining how she gained her testimony of the gospel and the church. I personally find my mom's response and testimony inspiring and powerful. It strengthens my own faith in the gospel of Jesus Christ.

Below is my Mom's letter. For privacy reasons, I have omitted the name of the individual to whom the letter was addressed. It should also be noted my mother grew up in California so one can better understand the place names she occasionally refers to.

<< Beginning of Letter >>

"I'm going to answer your question--do I believe in my faith because of my upbringing, or do I believe because of my own effort? Probably both.

I guess as long as I can remember, the doctrines and history of the Restored Gospel of Jesus Christ just made sense. I never felt uncomfortable learning about it. Perhaps as a child, like all children, I figured my parents wouldn't lie, so it must be true. The logic of a child, you know. As I grew older, I gleaned more information and the more I learned, the more it fascinated me. I loved going to Primary on Wednesday afternoons. No one picked me up. There were no car pools. Our first chapel was about a ½ mile west of Juana. I remember crossing Bancroft Avenue when the street had no traffic lights. I was very cautious crossing that busy street. (I can't believe my parents let me do this alone). I could have easily ditched Primary and gone to the library which wasn't too far from my home. I could have adventured to San Leandro Creek, just north of the Bancroft Junior High School. Or, I could have been tempted to go to Lucky's, the grocery store directly across from the chapel. That option never entered my mind. It was no temptation.

As I said, I loved Primary. Sister Wakefield must have been the chorister for more than a decade! I loved to sing Primary songs. It was one of the highlights of Primary because she made it so fun. Sister Wakefield's daughter, Julie, was one of my closest church friends. She liked to sing too and we both sung and sat together. We even sang duets in Sacrament. We were a hit--Wakefield and Frye, or Frye and Wakefield! Not only did I love to sing, I loved bringing my pennies so I could drop them in this fake but beautifully decorated cake. We were told the money was for the Primary Children's hospital, and we were reminded every week to bring our little pennies or whatever we had, to help the sick children in Salt Lake City. I felt so good inside. It was just a joyful, sweet experience I looked forward to every week.

My teachers were awesome, even though I can only remember Sister Painter. I still remember a question I asked her. Remember, this was in the late 50's, early 60's. We were talking about prayer and how our Heavenly Father listens to every prayer and wants us to return and live with Him someday. I raised my hand and asked, "Sister Painter, how can God answer all those prayers? Do you think He has computers to help him?" Now I'm sure Sister Painter restrained herself from raucous laughter, but it was her attitude I'll never forget. She said so seriously, "Well, Linda, you know, He just might have!" No one in class laughed at my question or the answer. We were just so curious how God accomplished this great feat. She didn't upbraid me and she could have. Sister Painter treated my question as though it was a most scholarly one... I still don't have the answer how God answers all those prayers. I just know prayer works.

When I became a "teenager", 13 to be exact, I had the great opportunity to participate in the Oakland Temple Pageant. This was a missionary tool to explain the history of the church through drama, dance and song. I was supposed to be 14 to be eligible to participate, but the leaders took pity on me and I snuck in.

The Pageant was held for two weeks. The East Bay would do it one week, and the West Bay would do it the other week. San Leandro was in the East Bay. There were many, many long rehearsals. Sister Benson drove Pat and I clear down to San Jose every Saturday to learn the dances. I had early morning Seminary, so coming home late from rehearsal on school nights was rough on me. Early morning has never been my cup of tea, so this was a sacrifice for me. There were strict attendance rules. We had to be to every practice and every rehearsal unless we were sick. I performed in the Pageant for four years straight, every summer. Pat and I were the Cover Girls on the very first program. They used those programs for years!  It was a great honor and opportunity. There were about 300 choir voices from each group alone! We had hundreds of volunteers and performers.

We always started rehearsal with prayer. On one school night dress rehearsal, the cast must have listened to Joseph Smith's vision more times than we wanted to. I was eager to get to the scene where the dancers came out! As the actor was relating the testimony of Joseph Smith's vision in the grove, I remember thinking, "Gee, I wonder if this really happened." Something powerful, something sweet, and something soothing enveloped me. I had never experienced this feeling before. All I know is, I felt suddenly warm and calm. Then in another scene, when Moroni--a Polynesian actor--sang, "I Would Exhort You" I felt this mysterious sweetness a little longer, a little warmer. The lyrics came from the scripture in Moroni 10:4-5 : "I would exhort you, I would exhort you, that ye would ask God the Eternal Father, In the name of Christ, if these things are not true. And if ye shall ask with a sincere heart, with real intent, having faith in Christ, he will manifest the truth of it unto you, By the power of the Holy Ghost, by the power of the Holy Ghost." The actor's voice matched his strong, muscular appearance. It actually seemed for one small moment, that he was really Moroni bearing truth. I got chills all over. Again, I felt a warmth in my chest which lingered throughout rehearsal. I started to cry a little. They were tears of confidence, a surety, that this Joseph Smith was indeed a prophet of God who bore solemn testimony that he talked to God, the Eternal Father and Jesus Christ. He could not deny what he saw. He died with his testimony. Never once have I heard or read Joseph Smith to ever say, "Just kidding". Nor will I ever deny what I felt & learned that evening.

There is opposition in all things. Weird things began to happen before and after some performances. My memory is a bit weak, but I do remember a time when some girls "got the shakes" or had some kind of a convulsion come over them. No, these were not epileptic seizures. They immediately got a priesthood blessing. The shakes ceased. One evening, I went outside just to get a breath of fresh air. Others told me something odd was happening outside. That piqued my curiosity, so I stepped out. It was dark and you could feel the wind on your body, you could hear the wind blowing, but the palm trees' leaves did not move at all! It was so bizarre because, usually when there's wind blowing, the leaves blow too. It scared me, so I stepped inside quickly. I think it was this same night, after we sang the finale song, the Spirit of God Like a Fire is Burning, the cast and audience experienced a surprise ending! The finale was spectacular. Over 400 voices sang the hymn. On both aisles of the room, young people dressed in different native costumes were holding the flag of that country. The hymn ended. Then, out of nowhere, a middle aged man suddenly stands up shouting, "This is the Church of the Devil!" You could hear a pin drop. Nico Snell, our talented musical director, very calm and dignified quietly said, "Thank You." and a prayer was given.

So, how come I felt so good and this other guy was so vehemently repulsed by it? Who's right and who's wrong? Answer: The struggle between man's philosophies versus God's truth relayed by the Spirit of the Holy Ghost. Yep, you got it. Good versus evil. Light vs. Darkness. Truth vs. Untruths or Part truths.

In closing, skeptics could conveniently "tear my experience to shreds" by suggesting I was brainwashed, emotional, tired, misguided.  Korihor, an anti-Christ called it the "effects of a frenzied mind." I believe the key to discovering and embracing truth is to ask God if "these things are not true." Ask. Ask. Ask. God doesn't knock the door down and force truth down our throats. Heavenly Father and Jesus didn't descend uninvited to Joseph. Joseph invited the Lord by asking with a humble heart. That was the prerequisite, to ask with a sincere heart, having faith in Christ. 'And by the power of the Holy Ghost ye may know the truth of all things...for He worketh by power, according to the faith of the children of men, the same today and tomorrow and forever.' (Moroni 10:7)"

<< End of Letter>>

My mother also shared this letter with all the children of the family. She recorded the following, on March 12, 2004, relating to the letter:

"I sent my testimony via e-mail to all my children, as I don’t recall ever explaining to them how I gained my testimony.  Taylor wrote back and said he thought it was very gentle, but powerful.  It is my hope that whoever reads this, will be touched by the Holy Ghost and know for a certainty, that the above scripture [Moroni 10:7] is true!" - Linda Frye Hartley 

Thursday, October 8, 2015

Modern Day Witnesses of the Resurrected Jesus Christ

Jesus Christ, the Savior and of the world, continues to manifest himself personally to his authorized apostles in our day. I want to share three particular testimonies given by modern day apostles where they declare they personally know the Lord, have seen him, and have personally been ministered unto by Him. These modern day apostles are like the mighty apostles of old in the Bible that knew Jesus personally and taught with power and authority. Below is a video clip of these three testimonies along with their accompany source and text:





And now, as pertaining to this perfect atonement, wrought by the shedding of the blood of God—I testify that it took place in Gethsemane and at Golgotha, and as pertaining to Jesus Christ, I testify that he is the Son of the Living God and was crucified for the sins of the world. He is our Lord, our God, and our King. This I know of myself independent of any other person.

I am one of his witnesses, and in a coming day I shall feel the nail marks in his hands and in his feet and shall wet his feet with my tears.

But I shall not know any better then than I know now that he is God’s Almighty Son, that he is our Savior and Redeemer, and that salvation comes in and through his atoning blood and in no other way.


I am a witness of the Resurrection of the Lord as surely as if I had been there in the evening with the two disciples in the house on Emmaus road. I know that He lives as surely as did Joseph Smith when he saw the Father and the Son in the light of a brilliant morning in a grove of trees in Palmyra.

This is the true Church of Jesus Christ. Only in the priesthood keys held by President Thomas S. Monson is the power for us to be sealed in families to live forever with our Heavenly Father and the Lord Jesus Christ. We will on the Day of Judgment stand before the Savior, face to face. It will be a time of joy for those who have drawn close to Him in His service in this life. It will be a joy to hear the words: “Well done, thou good and faithful servant.” I so testify as a witness of the risen Savior and our Redeemer in the name of Jesus Christ, amen.


After all the years that I have lived and taught and served, after the millions of miles I have traveled around the world, with all that I have experienced, there is one great truth that I would share. That is my witness of the Savior Jesus Christ.

Joseph Smith and Sidney Rigdon recorded the following after a sacred experience:

“And now, after the many testimonies which have been given of him, this is the testimony, last of all, which we give of him: That he lives!

“For we saw him” (D&C 76:22–23).

Their words are my words.

[...] I bear my testimony that the Savior lives. I know the Lord. I am His witness. I know of His great sacrifice and eternal love for all of Heavenly Father’s children. I bear my special witness in all humility but with absolute certainty, in the name of Jesus Christ, amen.

***

Free Online Bible Videos of Jesus Christ:


Additional information:





Sunday, August 2, 2015

From Failure to Success - My Brother's Miracle During Law School

This is an experience my brother Taylor Hartley went through over 10 years ago while at California Western School of Law in San Diego, California. The image to the left is Taylor's diploma. This diploma is particularly notable because what originally started as a failure later became a success by means of a miracle. When I see Taylor's diploma, it is more of a reminder to me that trusting in and relying on God -- even if it contradicts man's wisdom -- leads to more favorable outcomes than otherwise.

Here are Taylor's own words of the experience:

"When in law school, I failed my first semester miserably. My grades were so poor that the school invited me to withdraw. I was shattered. When I discussed the idea of not withdrawing with a school administrator, she told me that because of decades of experiences with students in my position, every one of them has never been able to bring their grades up high enough to stay in law school. She told me that I should withdraw now and come back in a few years. Otherwise, if I stay in, I'll end up failing and never be allowed to come back.

Instead of following her advice, I asked a friend for a priesthood blessing. In that blessing, the Lord promised me I would be able to “fix” my grades. I understood that to mean that I would not only temporarily improve my grades, but that I'd never be in fear of being kicked out. I decided to stay and give it my best effort.

After struggling my hardest and by reviewing what I had learned each day during my nightly prayers, I took my final exams. I experienced something I believe is a miracle, based on what the school administrator had predicted. I ended up scoring the highest out of over 70 students in the class I had failed the worst. I scored high in one class and very high in another that I had both failed. Even though my grades improved more than the school had ever seen, I was placed in a remedial class for extra tutoring. There, I showed the tutoring professor my grades. He was shocked. He had never seen a student recover like I did and told me I didn't belong in his class.

As a result of performing the best in the class I originally did worst in, I was selected the following year to be a "large group tutor" for all the new, incoming 70+ students in that class. I also tutored other students individually. Later, I was repeatedly asked to be a notetaker in a number of classes for the foreign and disabled students attending, so that they had written material from the lectures to study from.

In the remaining two years of law school, I also scored the highest out of all the students in a class each year. I saw these series of events at law school as another fulfillment of the promise in my patriarchal blessing. The Lord promised, 'I bless you that your mind and intellect will be quickened so that you will comprehend and understand those things that you read and study. That your testimony and knowledge of the Gospel will be greatly strengthened.'

Truly, my intellect was made alive so that I understood those things that I studied. This miracle mirrored in some ways the first miracle I had as a teenager. I was able to read only the Book of Mormon during a time when I lost the ability to read due to a traumatic brain injury. In essence, my mind during that time was quickened so that I comprehended what I was reading in that sacred scripture (but still couldn't read any other books at that time). Both experiences greatly strengthened my testimony of Christ's Gospel and priesthood power."

<< End of Taylor's Words >>


I can confirm that what Taylor wrote above is true. I saw his college transcripts and can verify the drastic improvement in his grades, which allowed him to graduate from law school.

More details about Taylor's head injury as a teenager and the miraculous event involving the Book of Mormon can be found here:

Friday, April 3, 2015

Machine Learning Fun - Predicting Authorship from 40 Year-old Talks

I am continuing my fun with applying statistical and machine learning methods to General Conference talks. This post will explore if you can predict the author/speaker of a general conference talk today, but by using talks given over 25-40 years ago. Since Thomas S. Monson, Boyd K. Packer and L. Tom Perry are the most senior apostles and general authorities, I used them as case studies because they have the most general conference talks available. The oldest general conference talks available go back until 1971 on LDS.org.

The idea is this: Can the occurrence of certain words from talks given 25-40 years ago by these speakers be used to accurately predict if they are the author of a recently given talk -- but assuming we only had the text of the recent talk and knew nothing about who actually gave it? Let's find out...

Representing Talks as 0s and 1s

We first need to determine if we can statistically distinguish authorship between the three speakers from the talks given 25-40 years ago. I will be attempting to distinguish authorship based on the presence or absence of certain words in a talk.

I had the computer create four different dictionaries based on the most common words used among all three speakers. Each dictionary was a different size of unique words as follows: 128 words, 267 words, 542 words, and 1042 words. 

The dictionaries were derived from almost 120 total talks, with about 40 talks given from each speaker. The talks had over 8,000 unique words after combining similar words together to avoid double counting. For example, jump and jumping would be considered the same word; they would be counted as being one unique word 'jump'.

Based on those dictionaries, each talk was then turned into a spreadsheet-like document. Each row represents a certain talk, and each column represents a particular word. The cells of the spreadsheet contain a 0 if a certain word is absent, or a 1 if a word is present. This means we are numerically representing each talk as a bunch of 0s and 1s based on word occurrences. This method is like giving a fingerprint to each talk. In sum, we're hoping to see if there are patterns in the talks' "fingerprints" that correspond to certain speakers.

Visualizing Similarity/Differences Among Talks and Speakers

After creating the giant spreadsheet full of 0s and 1s, the talks were then converted mathematically into coordinates on a two-dimensional plane. The 120 talks were also previously labeled on the spreadsheet so we would know which speaker gave each talk.

Plotting the talks visually allows us to better understand how similar or different they are from each other. If a certain speaker's talks are all being grouped together closely, but also being far away from other speakers' talks, this will confirm we have statistically distinguished authorship based on word occurences! Thereafter, we can attempt to predict authorship of new talks without knowing who the author is in advance! This means we are leveraging experience gleaned from the 120 older talks to predict authorship of new talks given more recently!

Plots of Talks and Speakers

Below is how the 120 older talks look like from the 128 word dictionary. Each circle, triangle or square is an individual talk corresponding to a certain speaker.

You can see in the chart there is a lot of overlap among speakers. This means the 128 word dictionary isn't very effective to distinguish authorship since all the talks look the same (statistically speaking).

Below is how the talks look like from the 267 word dictionary:


This 267 word dictionary looks quite a bit better -- there is more separation among speakers but there is quite a bit of overlap still.

Here is how the talks look like from the 542 word dictionary:
The 542 word dictionary is looking pretty good! There is quite a bit of separation between speakers and only a little bit of overlap between Monson and Perry. This goes to show that these three speakers have particular word choices that give them a somewhat unique identity! It may not be possible to totally separate all the speakers statistically speaking, but it looks like combinations of at least 542 words can be a powerful way to identify authorship. However, let's see if we can improve this any further.

Here is how the talks look like from the 1042 word dictionary:
The 1042 word dictionary looks fantastic! There is a lot of separation among speakers and just barely a bit of overlap. Apparently, the presence or absence of the 1042 selected words appears to distinguish authorship very well! Now that we've determined that authorship among the three speakers is distinguishable, let's get on to the predictions.

Predicting the Author/Speaker of a New Talk

I collected 16 recent talks given between 2012-2014 by Monson (5 talks), Packer (5 talks) and Perry (6 talks). The computer was never told in advance who the true author was of each talk. To predict authorship, the texts of the new talks were also turned into spreadsheets of 0s and 1s using the 1042 word dictionary developed earlier (the 120 talks given between 1970-1990). Thereafter, those 0s and 1s of the new talks were converted into coordinates for a two-dimensional plane.

Now, at this point, prediction is easy. The speaker/author of the talk will be estimated based on where a talk lands on the two-dimensional plane and where its position is in relation to the 120 talks earlier. We saw earlier there were three distinct groups of talks, with each group corresponding strongly to a particular speaker. So, if a new talk -- whose speaker is unknown in advance to the computer -- lands firmly within the territory of the talks from speakers we knew from earlier, we will then predict that this was the author of the new talk!

Results and Plots of Selected Predictions

After following this method, the author/speaker for 13 of 16 talks was correctly predicted! That is an 81% success rate! This isn't half bad considering the simplicity of the methods employed. Overall, it appears the text in talks given from 25-40 years ago have predictive power to determine the author of a talk given today! These three speakers -- Thomas S. Monson, Boyd K. Packer, and L. Tom Perry -- appear to have been mostly consistent with their word choices over the years to allow this to happen!

Here are the plots of the three talks that had incorrectly predicted authors/speakers:

1) Love -- The Essence of the Gospel - April 2014
Predicted Speaker: L. Tom Perry 
Actual Speaker: Thomas S. Monson


This makes sense why the prediction went wrong. The blue diamond is right on the border between Monson and Perry.

2) Obedience to Law Is Liberty - April 2013
Predicted Speaker: Boyd K. Packer
Actual Speaker: L. Tom Perry

It looks like this particular talk by Perry had Packer-esque word occurrences. This blue diamond is quite a bit inside Packer territory.

3) The Doctrines and Principles Contained in the Articles of Faith - October 2013
Predicted Speaker: Boyd K. Packer
Actual Speaker: L. Tom Perry

Here is another talk that was on the border -- this time between Packer and Perry. Talks landing in the border zone introduce more ambiguity, so it makes sense the computer got this one wrong.


Here are plots of some talks that correctly predicted speakers:


1) Finding Lasting Peace and Building Eternal Families - October 2014
Predicted Speaker: L. Tom Perry
Actual Speaker: L. Tom Perry
This talk is firmly in Perry territory.


2) The Reason for Our Hope - October 2014
Predicted Speaker: Boyd K. Packer 
Actual Speaker: Boyd K. Packer 

This talk is firmly in Packer territory.

3) True Shepherds - October 2013
Predicted Speaker: Thomas S. Monson 
Actual Speaker: Thomas S. Monson
 


This talk was in the ambiguous border zone between Monson and Perry, but the computer happened to get the author/speaker right. This one looks like a tough call visually speaking. 

In closing, this little project was a lot of fun. I should note, however, that it is much more important to actually read the general conference talks and apply their messages to our everyday lives. It is a great blessing to have prophets, seers, and revelators among us to give us the guidance we need today!

***

Previous posts related to statistics/text analytics of general conference talks:

Text Analytics Fun - Visualizing Sentiment Between General Conference Talks


Statistics Fun - Visualizing Similarity Between General Conference Talks

***

Summary of methodology:

  • R was used for all analysis/visualization
  • Each conference talk was copy and pasted into its own text file to make a corpus of documents.
  • The corpus was prepared by removing numbers, punctuation, sparse words and applying stemming.
·         A term document matrix was created using binary representations for word occurrences or absences.
·         Distance was calculated from term document matrix using the asymmetric binary/Jaccard method.
·         Classical multidimensional scaling was applied to the Jaccard distances to project talks onto a two dimensional space ("X and Y coordinates").

  • Author/speaker prediction was done using the IBk algorithm (nearest-neighbor) from the RWeka package. Three nearest neighbors were used in voting for classification.

Monday, March 23, 2015

Text Analytics Fun - Visualizing Sentiment Between General Conference Talks

I decided to have some more fun with the April 2014 General Conference talks. This time, I applied some basic text analytics and natural language processing techniques to estimate each talk's overall sentiment. In general, a talk with "positive sentiment" uses more optimistic type words and a talk with "negative sentiment" uses more pessimistic type words.

Below is a chart summarizing the sentiment differences for each talk, but only based on adjectives and adverbs a computer algorithm automatically identified for me. Adjectives and adverbs tend to be the types of words that convey sentiment. Surprisingly, Talk #17 -- Love—the Essence of the Gospel -- had the most negative sentiment! Go figure! Talk #16 -- Live True to the Faith -- had the most positive sentiment! (Cell phone users - click/tap image to expand and see fine text)



 [1] A Priceless Heritage of Hope
 [2] Are You Sleeping through the Restoration
 [3] Be Strong and of a Good Courage      
 [4] Bear Up Their Burdens with Ease  
 [5] Christ the Redeemer      
 [6] Daughters in the Covenant
 [7] Fear Not; I Am with Thee   
 [8] Following Up  
 [9] Grateful in Any Circumstances  
[10] I Have Given You an Example  
[11] If Ye Lack Wisdom
[12] If Ye Love Me, Keep My Commandments   
[13] Keeping Covenants Protects Us Prepares Us and Empowers Us
[14] Let's Not Take the Wrong Way 
[15] Let Your Faith Show 
[16] Live True to the Faith   
[17] Love—the Essence of the Gospel   
[18] Obedience through Our Faithfulness
[19] Protection from Pornography—a Christ-Focused Home 
[20] Roots and Branches  
[21] Sisterhood Oh How We Need Each Other  
[22] Spiritual Whirlwinds    
[23] The Choice Generation 
[24] The Cost—and Blessings—of Discipleship 
[25] The Joyful Burden of Discipleship
[26] The Keys and Authority of the Priesthood  
[27] The Priesthood Man 
[28] The Prophet Joseph Smith 
[29] The Resurrection of Jesus Christ 
[30] The Witness 
[31] Wanted Hands and Hearts to Hasten the Work
[32] What Are You Thinking
[33] What Manner of Men  
[34] Where Your Treasure Is 
[35] Your Four Minute


I also made a second chart showing sentiment differences, but this time it was based on all words which the sentiment lexicon/dictionary could identify and was not limited to just adjectives and adverbs. With this method, Talk #5 -- Christ the Redeemer -- ended up having the most negative sentiment! Talk #13 -- Keeping Covenants Protects Us Prepares Us and Empowers Us -- had the most positive sentiment.  



Overall, this was a fun exercise to see how general conference talks vary sentiment-wise. The methodologies and computer algorithms utilized for this analysis are by no means perfect, but they are surprisingly useful to get additional insight and extract information from text.

***

Summary of methodology:

·         R was used for all analysis/visualization. Libraries tm, NLP, openNLP, proxy, RWeka, openNLPmodels.en, and stringr used.
·         Each conference talk was copy and pasted into its own text file to make a corpus of documents.
·         Harvard's Inquirer Lexicon/Dictionary was used to estimate sentiment, but with some modifications by myself. This dictionary can be accessed at these links: http://www.wjh.harvard.edu/~inquirer/homecat.htm  (general page) or directly at http://www.wjh.harvard.edu/~inquirer/spreadsheet_guide.htm
·         Sentiment was estimated for each talk individually by taking the total number of positive sentiment words and dividing it by the total number of all sentiment words (positive + negative) the Lexicon could identify.

  • The mean sentiment for the group of 35 talks was 72%. I.e. on average, of all the sentiment type words identified, 72% of them were positive in the talks.    

Sunday, March 15, 2015

Statistics Fun - Visualizing Similarity Between General Conference Talks

I decided to have a little fun by applying statistical methods to some past general conference talks. I took each talk from the April 2014 General Conference  (35 of them) so the following could be done:

1) Estimate relative similarity between talks based on word counts/occurrences
2) Visualize how similar/dissimilar talks are by projecting their relative positions onto two-dimensional space
3) Assign talks that are most similar into their own group

Below is what the April 2014 General Conference looks like in two-dimensional space. Each circle is a talk, and circles closer together indicate they are more similar. Circles farther away indicate being less similar. A statistical tool estimates there being six groups of similar talks, so each group of similar talks is represented by its own color. The exact numbers on X and Y axes don't mean anything in particular other than a way to measure relative distance among talks.


Well, which talk is which? Below is the same chart using numbers instead of circles. A legend is also provided showing the title of each talk and its corresponding number:

Legend:

Number
Talk
Group
1
A Priceless Heritage of Hope
2
2
Are You Sleeping through the Restoration
3
3
Be Strong and of a Good Courage
3
4
Bear Up Their Burdens with Ease
2
5
Christ the Redeemer
6
6
Daughters in the Covenant
1
7
Fear Not; I Am with Thee
2
8
Following Up
3
9
Grateful in Any Circumstances
3
10
I Have Given You an Example
2
11
If Ye Lack Wisdom
5
12
If Ye Love Me, Keep My Commandments
4
13
Keeping Covenants Protects Us Prepares Us and Empowers Us
1
14
Let's Not Take the Wrong Way
5
15
Let Your Faith Show
5
16
Live True to the Faith
2
17
Love—the Essence of the Gospel
3
18
Obedience through Our Faithfulness
4
19
Protection from Pornography—a Christ-Focused Home
2
20
Roots and Branches
3
21
Sisterhood Oh How We Need Each Other
1
22
Spiritual Whirlwinds
2
23
The Choice Generation
2
24
The Cost—and Blessings—of Discipleship
3
25
The Joyful Burden of Discipleship
3
26
The Keys and Authority of the Priesthood
1
27
The Priesthood Man
2
28
The Prophet Joseph Smith
5
29
The Resurrection of Jesus Christ
6
30
The Witness
5
31
Wanted Hands and Hearts to Hasten the Work
1
32
What Are You Thinking
5
33
What Manner of Men
1
34
Where Your Treasure Is
3
35
Your Four Minutes
2


Summary of groups:

Group: 1

[1] Daughters in the Covenant                               
[2] Keeping Covenants Protects Us Prepares Us and Empowers Us
[3] Sisterhood Oh How We Need Each Other                    
[4] The Keys and Authority of the Priesthood                
[5] Wanted Hands and Hearts to Hasten the Work              
[6] What Manner of Men
                                    
Group: 2
   
[1] A Priceless Heritage of Hope                    
[2] Bear Up Their Burdens with Ease                 
[3] Fear Not; I Am with Thee                        
[4] I Have Given You an Example                     
[5] Live True to the Faith                          
[6] Protection from Pornography—a Christ-Focused Home
[7] Spiritual Whirlwinds                            
[8] The Choice Generation                           
[9] The Priesthood Man                              
[10] Your Four Minutes                               

Group: 3
   
[1] Are You Sleeping through the Restoration
[2] Be Strong and of a Good Courage        
[3] Following Up                           
[4] Grateful in Any Circumstances          
[5] Love—the Essence of the Gospel         
[6] Roots and Branches                     
[7] The Cost—and Blessings—of Discipleship 
[8] The Joyful Burden of Discipleship      
[9] Where Your Treasure Is
              
Group:  4

[1] If Ye Love Me, Keep My Commandments
[2] Obedience through Our Faithfulness

Group:  5

[1] If Ye Lack Wisdom           
[2] Let's Not Take the Wrong Way
[3] Let Your Faith Show        
[4] The Prophet Joseph Smith   
[5] The Witness                
[6] What Are You Thinking      

Group:  6

[1] Christ the Redeemer            
[2] The Resurrection of Jesus Christ


Overall, it appears the utilized statistical methodology did a pretty good job of putting similar talks closer to each other and grouping similarly themed talks! This is not bad considering the methods are based on word occurrences/counts and not actually "reading" the talks and understanding them! If you actually read the talks, you can understand even better why certain talks are closer to or father away from each other.

***

Summary of methodology:

  • R was used for all analysis/visualization. Libraries tm, ggplot2, and proxy used.
  • Each conference talk was copy and pasted into its own text file to make a corpus of documents.
  • The corpus was prepared by removing numbers, stop words, applying stemming, removing sparse words, and more.
  • A term document matrix was created on word occurrences and then weighted using the term frequency-inverse document frequency method. Distance was calculated between each talk from those weights using cosine similarity.
  • Multidimensional scaling was applied on the cosine distance of the weighted term document matrix to project talks onto a two dimensional plane.
  • K-means clustering was applied to cluster/group similar general conference talks. The optimal number of clusters was estimated using the sum of squared errors scree plot. I borrowed previously written R code for this purpose from the following link: http://stackoverflow.com/questions/15376075/cluster-analysis-in-r-determine-the-optimal-number-of-clusters