ENHANCING DATA ANALYSIS EFFICIENCY :A COMPARATIVE STUDY OF EXCELS VBA & POWER QUERY VS. PYTHON FOR LARGE-SCALE DATA PROCESSING.

Data analysis forms one of the backbones for modern decision-making, and selecting an efficient tool to process large datasets is important in this day & age. Even though Microsoft Excel is still the dominant player in business analytics, it also relies on VBA (Visual Basic for Applications) and Power Query to achieve its power. Meanwhile the Python programming language is scalable, can be built as an automated Modeler and has capabilities to interface with advanced analytics frameworks. Comparison of Power Query and Excel VBA with Python for Data Processing HUGE data in big number. We use a simple benchmark suite to measure the wall-time execution, memory usage and usability of different data processing tasks (cleaning/transformation/aggregation). It all comes down to choice of tools, depending on scenario. This research provides some practical advice for data analysts, business professionals and businesses to select the right tool according to their requirement. This work is a step forward in the discussion around which data analysis tools are best for various users [9], enabling professionals to structure their workflows accordingly and allow them to reach more efficient data-driven decision processes.