4.1 Insights from large datasets
Interactive, GPU-accelerated exploration.
Key points
Visualization helps the brain take in large amounts of information quickly. NVIDIA notes interactions slower than 7-10 seconds disrupt the user's short-term memory. Graphics processing unit (GPU) libraries bring compute and render times down to interactive speeds.
What NVIDIA says (3)
“However, interactions such as filtering, selecting, or rerendering points that are slower than 7-10 seconds result in a disruption of a user”
“This style of visualization is essentially a hack for the brain to understand large amounts of information quickly.”
“Visualization compute and render times are brought down to interactive speeds”
NVIDIA's guide says that when an exploratory data analysis (EDA) workflow processes more than 2 gigabytes (GB) with compute-intensive tasks, central processing unit (CPU)-based tools can slow iteration. Switching to pandas-like RAPIDS graphics processing unit (GPU) libraries such as cuDF keeps the pace up.
What NVIDIA says (2)
“But when an EDA workflow is processing data larger than 2 GB, and requires compute intensive tasks, CPU-based solutions can start to constrain the iterative exploration process.”
“Replacing CPU-based libraries with the pandas-like RAPIDS GPU-accelerated libraries (such as cuDF) means you can keep a swift pace for your EDA process”
cuDF is a pandas-like RAPIDS graphics processing unit (GPU)-accelerated library. NVIDIA says it gives GPU acceleration through a familiar pandas-like application programming interface (API).
What NVIDIA says (2)
“enables GPU acceleration that unlocks access to your data insights through a familiar pandas-like API.”
“the pandas-like RAPIDS GPU-accelerated libraries (such as cuDF)”
Key terms
- cuDF: RAPIDS GPU DataFrame library with a pandas-like API.
- Exploratory data analysis: Open-ended exploration of a dataset to understand it before modeling.
Sample question
NVIDIA's RAPIDS visualization guide warns about interactions that are too slow. What happens when filtering or re-rendering takes longer than about 7-10 seconds?
Show the answer
Answer: It disrupts the user's short-term memory and train of thought, which hurts exploration
Visualization helps the brain take in large amounts of information quickly. NVIDIA notes interactions slower than 7-10 seconds disrupt the user's short-term memory. Graphics processing unit (GPU) libraries bring compute and render times down to interactive speeds.
What NVIDIA says (3)
“However, interactions such as filtering, selecting, or rerendering points that are slower than 7-10 seconds result in a disruption of a user”
“This style of visualization is essentially a hack for the brain to understand large amounts of information quickly.”
“Visualization compute and render times are brought down to interactive speeds”
Practice 4.1 (3 questions) Full Data Analysis and Visualization guide
← 3.7 Running experiments on models and pipelines · 4.2 Comparing models with statistics →