Machine Learning Projects for .NET Developers Apress 2015

1. Listing 2-9. Using regular expressions to tokenize a line of text
   
2. let casedTokenizer (text:string) =
   
3. text
   
4. |> matchWords.Matches
   
5. |> Seq.cast<Match>
   
6. |> Seq.map (fun m -> m.Value)
   
7. |> Set.ofSeq
   
8. let casedTokens =
   
9. training
   
10. |> Seq.map snd
    
11. |> vocabulary casedTokenizer
    
12. evaluate casedTokenizer casedTokens

复制代码

1. Listing 2-10. Extracting least frequently used tokens
   
2. let rareTokens n (tokenizer:Tokenizer) (docs:string []) =
   
3. let tokenized = docs |> Array.map tokenizer
   
4. let tokens = tokenized |> Set.unionMany
   
5. tokens
   
6. |> Seq.sortBy (fun t -> countIn tokenized t)
   
7. |> Seq.take n
   
8. |> Set.ofSeq
   
9. let rareHam = ham |> rareTokens 50 casedTokenizer |> Seq.iter (printfn "%s")
   
10. let rareSpam = spam |> rareTokens 50 casedTokenizer |> Seq.iter (printfn "%s")

复制代码

look and look

thanks

看看！

ding!!!!!!!!

谢谢楼主分享！

支持分享！