发帖
雷达卡
Abstract
Today the tremendous Big and complex data files are keeping changing, it causes more and more troubles to handle these data files with higher requirements. Banking is not an exception too, among daily work, how to handle tremendous data files, and significantly decrease execution time is a hot topic. We have many technical skills such as parallel runs, they work very well but with short-comings, and cannot hugely shorten the execution time. We found if we optimize the logic a little bit to handle the business requirements, process the steps with a combination processing or set processing method, we can hugely decrease the execution time. It does not require additional server memory, additional money, but can significantly decrease huge amount running time for our SAS engines. The more the number of data files, the larger of them, the more time we can decrease if we can mix SAS technical skills, parallel run or multiple threads and combination processing method into SAS engine. It can decrease more than 90% of execution time. We already did it.
Actually we already proved that this method does not only work in SAS language but also Python, and other computer languages.
Key Words: Large Data, shorten execution time, optimization, Combination Processing Method or Set Processing Method
提升卡
置顶卡
沉默卡
变色卡
抢沙发
千斤顶
显身卡
京公网安备 11010802022788号
