坐等高手：如何统计一篇文章中各字母的出现频率

如下面一篇英文文章：
It is Teacher's Day today. On this special occasion I would like to extend my heartfelt congratulations to all teachers, "Happy Teacher's Day!"    Of all teachers who have taught me since my early childhood, the most unforgettable one is my first English teacher in college, Ms. Zhang. It is she who has aroused my keen interest in the learning of English and helped me realize the importance of self-reliance. Born into a poor farmer's family in a mountainous area and educated in relatively primitive surroundings, I found myself lagging far behind in the first class in college, which happened to be Ms. Zhang's English class. I was really discouraged and frustrated, so I decided to drop out. Ms. Zhang was so keenly insightful that she had noticed my embarrassment in class. After class, she called me into the Teacher's Room and discussed the situation with me, earnestly and kindly, citing the example of Robinson Crusoe to motivate me to go ahead in spite of all kinds of difficulties. "Be a man and rely on yourself," she nudged me. The next time we met, she brought me a simplified version of Robinson Crusoe and recommended that I finish reading it in a week and write a book report. Under her consistent and patient guidance, not only has my English been greatly improved, but my confidence and courage enhanced considerably.    "Rely on yourself and be a man," Ms. Zhang's inspiring words have been echoing in my mind. I will work harder and try my utmost to lay a solid foundation for my future career. Only by so doing can I repay Ms. Zhang's kindness and live up to her expectations of me, that is, to become a useful person and contribute to society.


其中有各种字符，如果想统计26个英文字母（不考虑大小写）在这篇文章中出现的次数和频率，sas是否有能力解决这个问题？如果可以，需要怎么做，如果高手愿意写程序，感激不尽，本人论坛币较少，就只悬赏10个了。主要是交流学习
第二个问题：能否统计在这里面出现的全部单词有哪些，每个单词出现了多少次？

data ex;
infile "e:\x.txt" delimiter='@' lrecl=2000;
input x:$5000.;
run;

data ex1;
set ex;
array char(4) $ _temporary_  ('a','b','c','d');
do i=1 to dim(char);
name=char(i);
count=count(lowcase(x),compress(char(i)));
output;
end;
drop x i;
run;


data ex2;
infile "e:\x.txt"  lrecl=2000;
input x:$20. @@;
x=compress(lowcase(x),'','p');
run;

proc sql;
create table ex3 as
select x,count(*) from ex2 group by x;
quit;
大体思想就是这样，有些细节可能还要加工一下

ziyenano 发表于 2012-9-5 15:26
data ex;
infile "e:\x.txt" delimiter='@' lrecl=2000;
input x:$5000.;

高手，infile中的delimiter="@''是什么意思，貌似是强制读取下一行数据。可是如果数据弄到cards里面就不能用了，为什么，还有，即便是在txt里面，如果将数据变成多个段落，也不能保证将全部数据导入一个观测中，望高手指点

ziyenano 发表于 2012-9-5 15:26
data ex;
infile "e:\x.txt" delimiter='@' lrecl=2000;
input x:$5000.;

另，高手，删除标点符号有没有办法只删除字符串开始和结尾的，而不删除中间的。
如student's 这个中间的标点符号不要删除

1. data test;
   
2. input text & $260.;
   
3. cards;
   
4. It is Teacher's Day today. On this special occasion I would like to extend my heartfelt congratulations to all teachers, "Happy Teacher's Day!"
   
5. Of all teachers who have taught me since my early childhood, the most unforgettable one is my first English teacher in college, Ms. Zhang.
   
6. It is she who has aroused my keen interest in the learning of English and helped me realize the importance of self-reliance.
   
7. Born into a poor farmer's family in a mountainous area and educated in relatively primitive surroundings, I found myself lagging far behind in the first class in college,
   
8. which happened to be Ms. Zhang's English class. I was really discouraged and frustrated, so I decided to drop out. Ms. Zhang was so keenly insightful that she had noticed my embarrassment in class.
   
9. After class, she called me into the Teacher's Room and discussed the situation with me, earnestly and kindly, citing the example of Robinson Crusoe to motivate me to go ahead in spite of all kinds of difficulties.
   
10. "Be a man and rely on yourself," she nudged me. The next time we met, she brought me a simplified version of Robinson Crusoe and recommended that I finish reading it in a week and write a book report.
    
11. Under her consistent and patient guidance, not only has my English been greatly improved, but my confidence and courage enhanced considerably. "Rely on yourself and be a man,"
    
12. Ms. Zhang's inspiring words have been echoing in my mind. I will work harder and try my utmost to lay a solid foundation for my future career.
    
13. Only by so doing can I repay Ms. Zhang's kindness and live up to her expectations of me, that is, to become a useful person and contribute to society.
    
14. ;
    
15. run;
    
16. 
    
17. 
    
18. 
    
19. /*分别统计每个字母的频数*/
    
20. %macro count_alpha(alpha);
    
21. data count_α
    
22. set test end=last;
    
23. index=0;
    
24. do until(index=0);
    
25. index=find(text,"&alpha",'i',index+1);
    
26. if index ne 0 then count+1;
    
27. end;
    
28. alpha="&alpha";
    
29. if last then output;
    
30. keep alpha count;
    
31. run;
    
32. %mend count_alpha;
    
33. /*统计所有的字母数*/
    
34. %macro count_all;
    
35. data count_all;
    
36. set test end=last;
    
37. index=0;
    
38. do until(index=0);
    
39. index=anyalpha(text,index+1);
    
40. if index ne 0 then count_all+1;
    
41. end;
    
42. if last then output;
    
43. keep count_all;
    
44. run;
    
45. %mend count_all;
    
46. /*开始计算输出*/
    
47. %macro calculate;
    
48. /*计算各字母出现频数*/
    
49. %do i=65 %to 90;
    
50. %count_alpha(%sysfunc(byte(&i)))
    
51. %end;
    
52. /*计算所有的字母数量*/
    
53. %count_all
    
54. /*计算出现频率*/
    
55. data all_alpha;
    
56. title "各字母频数、频率统计";
    
57. file print;
    
58. if _n_=1 then set count_all;
    
59. set
    
60. %do i=65 %to 90;
    
61. count_%sysfunc(byte(&i))
    
62. %end;
    
63. ;
    
64. rate=count/count_all;
    
65. put "字母" alpha "的频数是：" count "，出现的频率为：" rate;
    
66. run;
    
67. proc datasets lib=work nolist;
    
68. delete
    
69. %do i=65 %to 90;
    
70. count_%sysfunc(byte(&i))
    
71. %end;
    
72. ;
    
73. quit;
    
74. %mend calculate;
    
75. 
    
76. 
    
77. %calculate

复制代码

自己随便想了想，实现的。程序生成了26个数据集，这是非常没必要的，但懒得去改了！
看了几个回复，发现还有很多可以优化，发现很多sas的函数根本就不知道。悲剧！

txt中数据是一行，以@为分隔符，将数据读到一个观测中；cards中应该是可以的，分隔符设置为@或者是其他的符号，只要是文本中没有的字符；
如果在txt中是多段的话，要读到一个观测中，可以用行指针。

Imasasor 发表于 2012-9-5 16:50
另，高手，删除标点符号有没有办法只删除字符串开始和结尾的，而不删除中间的。
如student's 这个中间的 ...

这些细节用正则处理一下。

466046020 发表于 2012-9-5 17:01

学习了