• About The Regularized Singularity

The Regularized Singularity

~ The Eyes of a citizen; the voice of the silent

The Regularized Singularity

Monthly Archives: October 2014

Always be open to learning and new things

09 Thursday Oct 2014

Posted by Bill Rider in Uncategorized

≈ Leave a comment

Today we are having the funeral for my father-in-law, Louis Forbes. He was a wonderful man who acted as an example in numerous ways. One part of his character was exceptional and an example for all of us. He was always learning. He was always open to new things, new experiences all the way to the end.

 Lou didn’t have the advantage of a classical education growing up in rural depression-era North Carolina, but took the opportunities offered by military when he was drafted after WW2. His first assignment was to Los Alamos and then to the Atomic Weapons group at Sandia Base in Albuquerque. Along the way he learned a tradelouis-forbes-obituary that kept him employed into his 80’s and able to generously support his family.

 One of the things that stand out to me about Lou was his use of new technology. He had a smartphone and communicated via text messages, was online every day web surfing, e-mailing and posting on Facebook. When so many elderly people are flummoxed by technology, Lou embraced it.

 A lot of scientists would pride themselves on being technologically advanced; the reality is many get stuck within an era. Many people quit adopting new things at some point in their lives including scientists and engineers. We can all look to Lou as an example of someone who kept on learning, and experimenting with new things right up to the end.

It matters not how a man dies, but how he lives.
― James Boswell

What sort of calculation is it?

08 Wednesday Oct 2014

Posted by Bill Rider in Uncategorized

≈ Leave a comment

Insanity is everyone expecting you not to fall apart when you find out everything you believed in was a lie.
― Shannon L. Alder

When you are doing a single calculation a couple of things can happen; the calculation can run to completion and give you an answer, or the calculation can bomb. In reality we have four distinct possibilities:

  1. You will converge to the correct solution
  2. You will converge to a solution, but not the correct one
  3. You get a solution, but don’t converge
  4. No solution, unstable (code bombs).

This is really a continuum of solutions with varying degrees of eaimages-1 copy 3ch of these four categories. For example there might be a big difference between solutions that are wandering in phase space as opposed to one that is bouncing between several possible equilibrium points.

One day everything will be well, that is our hope. Everything’s fine today, that is our illusion

― Voltaire

Too often we simply see a single calculation be the end product. Determining what category your calculation is actually in has great bearing on the credibility of the calculation. In other words the credibility of a single isolated calculation is questionable a priori. You really need to be offering ensembles of calculations that together define the credibility rather than a single calculation.

Timages copy 5he point is that if your calculation runs to completion it could be in one of three states. You should be quite interested in which one. Verification is the vehicle to help you figure this out. You can really only start to sleuth out what state the calculation is in by doing a sequence of nearby calculations using variations in the models and methods. If you run a family of problems you will generally find that the easier problems converge to the exact solution without problems (assuming you have an exact solution). You can only distinguish between 1 & 2 when you have an exact solution.

41w95NM+2WL._SL500_AA300_As you raise the problem difficulty either by varying the parameters or geometry or materials, you will gradually get solutions that depart of the exact one, but converge to some solution. As the conditions for the problem become more extreme, the code will stop converging to a single answer, and ultimately encounter stability problems. For more complicated problems especially in multiple dimensions one may always be looking at problems that don’t converge to a single solution, nonetheless you should be asking these questions all the time.

Yesterday’s adaptations are today’s routines.

― Ronald A. Heifetz

 

The Story of the Viewgraph Norm

07 Tuesday Oct 2014

Posted by Bill Rider in Uncategorized

≈ 2 Comments

Anything worth doing, is worth doing right.
― Hunter S. Thompson

I’m pretty sure that I invented the term “viewgraph norm”. It isn’t a pretty story since the invention of the term came in a fit of frustration and disgust at a co-worker, but history doesn’t have to be pretty. The viewgraph norm is the modern compliment to the “eyeball norm”. Comparing results in the eyeball norm is not precise and doesn’t constsodanitute proof, it’s a rough check. Sometimes it is offered as evidence because the author doesn’t want to look to close either because they are lazy, or they know that the result won’t bear up under scrutiny.

It was back in 1997 or 1998 and I was working in Los Alamos’ Applied Theoretical Physics Division (i.e., the infamous X-Division). Every week or two we’d have a “work in progress” seminar given by one of the staff on an ongoing project. One of these talks was on comparing the solution on a number of standard test problems for shock physics. The talk looked at a number of the available computer codes on a number of test problems with analytical solutions. As the talk proceeded, it became crystal clear that the analytical solution would be used only for plotting.

The talk was simply a series of plots comparing the code solution to the plot of the analytical. The message was clear, everything is fine, and all the codes converge to the analytical. Never once was an actual numerical error computed, or convergence actually checked. I became disgusted and increasingly agitated because I knew the truth was far different, many, if not most of the codes were not convergent to the analytical solution because I had been running the same problems with the same codes.

Finally near the end of the hour and finding myself utterly revolted by the whole talk, I stormed out and exclaimed, “It converges in the viewgraph norm!”

The term lived on, and other used it to call out charlatans employing the same sort of proof in their talks, with comments like “nice viewgraph norm!” Over time, I developed a sort of metric for the actual quality of a viewgraph norm. The better a result afig6ctually is, the longer the speaker will leave the viewgraph up to be examined. If the result is poor, the viewgraph won’t be available for examination for more than a few seconds.

It also turns out that when it comes to shock tube solutions, the viewgraph norm is the standard. No one even today publishes the error magnitudes with solutions even though it is trivial, and the differences between methods (or codes) is quite substantial.

Do ordinary things extraordinarily well.

― Gregg Harris

Supercomputing is a Zombie

06 Monday Oct 2014

Posted by Bill Rider in Uncategorized

≈ 1 Comment

Late last week I tweeted that I thought high performance computing (HPC) was a zombie. I’ll admit that this is an intentionally provocative statement emblematic of the age of Twitter, but it is also worth some deeper thought too. So in my first daily blog post let me explain.

 The riskiest thing we can do is just maintain the status quo.

― Bob Iger

A zombie is a fearsome motif of modern horror, the product of post-modern feabike-girl-zombiers of technology, as well as a metaphor for the dehumanizing effect of the modern world. The zombie lives the existence of the undead driven by an inhuman hunger for flesh (or brains!). It has no other purpose, but to mindlessly consume the living.

So, why am I calling supercomputing a zombie?

Because it’s mindless, just lurching forward consuming resources without any vision of where it is going or why. We are just trying to have the fastest computer, so that we have the fastest computer instead of China. Whether the computer is useful for anything is really secondary or tertiary to the purpose of having the fastest computer. The unfortunate side-effect of this approach is that the computers are increasingly difficult to solve problems on, and little or no thought is going into how to use them.

At some point in time around 1990 people got the idea that we should rate supercomputer utility by their speed instead of a holistic view of the computer’s problem-solving utility. At some deeper level a computer is simply a tool to be utitansed. We don’t endeavor to have the World’s largest hammer or wrench; we recognize that these are tools whose function is essential. We don’t recognize this about computers, for some reason their status as tools has been lost. In this sense supercomputing research has become a bit of a fetish.

There are three classes of men; the retrograde, the stationary and the progressive.

― Johann Kaspar Lavater

 

A long time ago supercomputing was about solving problems, and it mattered whether the computer was actually useful for solving problems. Originally scientists envisioned solving problems through computation and then build computers to bring this vision to fruition. Speed was always welcome as long as the speed was useful. Along the way supercomputing underwent the transition to massively parallel computing as a matter of course.

 

Around that same time supercomputing was equivocated with National Security. The virus to create the zombie has infected the victim. It was just a matter of time before the zombie began to lurch forward hungrily devouring resources. The program to develop supercomputers had to be successful so they developed a new metric of success, weak scaling. Weak scaling is the ability to get ever-higher performance as the number of processors used to solve a problem grows as the problem size grows as well. It’s validity is predicated on the “bigger is better” point-of-view”.

 

What’s measured improves

― Peter F. Drucker

 

The problem with weak scaling is that it allows the computational intensity to drop (which it has) while yielding success. As a result weak scaling increasingly drives our computer development and the algorithms used on them. All the while their actual computational performance is plummeting. None of these measurements really have much to do with problem solving, just declarative success with building a faster computer. All of these advances only improve problem solving as a collateral benefit rather than the central purpose.

 

This is the zombie, a pursuit of a mindless goal without regard to any purpose beyond the pursuit itself.

 

Two reasons why people hate and/or fight change: (1) People fear the unknown; and (2) There are always people profiting from how things are.

― Mokokoma Mokhonoana

 

 

Daily Habits

06 Monday Oct 2014

Posted by Bill Rider in Uncategorized

≈ Leave a comment

I been contemplating things over the weekend and decided that a change was needed.habit This blog is intended primarily as a place for me to focus on positive habits like writing every day, and establishing more of an online presence. I think its working well, but I need change it up. I’ve decided to move to a daily blog post instead of the weekly one. The writing is usually related to something I’m working on, or thinking about, or ne
ed to talk about.

So, look for a new post every day starting later today.

We become what we repeatedly do.

― Sean Covey

A man who can’t bear to share his habits is a man who needs to quit them.

― Stephen King

Good habits are worth being fanatical about.

― John Irving

Colorful Fluid Dynamics

03 Friday Oct 2014

Posted by Bill Rider in Uncategorized

≈ 7 Comments

The purpose of computing is insight, not pictures.

– Nick Trefethen channeling his modern Richard Hamming

One of the most impressive achievements of computing is the stunning progress in simulating physical phenomena. Fluid mechanics holds a special place in the pantheon of scientific computing being among the first fields to see the achievements, and remains an exemplar of computing’s impact on science. Thecomputational_fluid_h discipline of computational fluid dynamics (CFD) defines this capability being responsible for many of the most iconic uses of computing and the visual power available today. Often when the results are given more to satisfy the eye rather than the mind CFD gets rechristened “Colorful Fluid Dynamics” as a slam. This is a sharp poke in the eye to the well-intentioned scientist seeking to impress someone through glitz rather than though convincing intellectual arguments.

Or at least I thought as much.

Many in the CFD world seem to accept the label of colorful fluid dynamics as a compliment and without a hint of irony. The eye poking isn’t even noticed. It is so common now for results to be taken as accurate simply because the graphics look cool that many rarely bother to do any real scientific work examining the validity of their calculations. Has the vapid and vacuous nature of the modern celebrity driven culture infected science? I think it has and certainly to a degree that I’m not comfortable with. Even worse it’s the extent to which color fluid dynamics has become a veritable currency of discourse in engineering (and related areas such as computational continuum mechanics).

Marketing is what you do when your product is no good.

– Edwin H. Land

 

When I first did CFD 25 year ago it was the idea of computing something that matched reality that grabbed my imagination. Cool, realistic looking visuals are certainly part of this, but not a replacement for really computing things that truly match reality they are a bonus. The “colorful fluid dynamics” is a slam, not unlike the perspective on the world of reality TV shows. Reality TV is a contrived and unrealistic view galleryoffluof people’s real lives with a great deal of flourish added for ratings because reality is actually grim, monotonous and boring most of the time. Simulation is similar in that most of the important stuff is boring, dull and utterly essential, cool visuals avoid all of the reality and replace it with an advertisement.

 

Fluid dynamics has the virtue of creating beautiful visuals through its natural nonlinear interactions. If simulated with even modest levels of fidelity fluid mechanics is stunning and beautiful. It grabs your attention and captures your imcomplex_vortex_streetagination without the slightest difficulty. Nothing creates patterns that wow the senses like the vortical motions that drive turbulence. These features are prevalent and have exemplified scientific visuals for hundreds of years. Fluid phenomena have stirred the curiosity of the greats including De Vinci who famously sketched the turbulence in a fountain. Every year we have a contest to create the most stunning and scientific compelling visuals put on by the American Physical Society in their Gallery of Fluid Motion taking off from Van Dyke’s classic book of the same name.

 

Day 334 - Fluid DynamicsIt should come as no surprise that computations of fluid dynamics have similarly stirred the artistic juices within modern science. The visuals arising from computation are compelling and seemingly reproduce the features seen in nature. Visualization software has become so good at creating beautiful images from computed data it actually works against aspects of science. In the sense of marketing the work of CFD, the visualization is the best advertising imaginable. Why rock the boat by asking whether the calculation is really mesh converged (what ever that means!), or whether the experimental data is modeling correctly? It just looks so damn cool! Our scientific management is simply so overworked and under-curious they are primed to accept the meager evidence offered by glimmering graphics as all the quality they need to see.

 

aerodynamicsThis is the problem that the tag colorful fluid dynamics is designed to project, an interest in how the computation looks over how good it really is. The colorful fluid scientists often reject the notion of looking deeply at the quality of what they do. This shouldn’t happen, but very often it does. Far too often they are successful and rewarded for their lack of focus on scientific content by rewarding showmanship and sleight of hand. The quality of computations is very important especially as computation becomes a greater player in decision-making across a vast variety of fields. Looking good and realistic is important, but that is a standard for Hollywood, not science.

 

On the other hand computations that appear realistic provide an important element of confidence for those seeing it. In many cases the appearance of calculations is not congruent with the quantitative assessment. A prime example is turbulence. Turbulent computations do not look much like turbulence observed in nature. One of the largest elements in what does not appear turbulent in computation is the degree of 47251czpgfpblintermittency, the large deviations from mean behavior. For visual purposes like Hollywood’s CGI, the methods need to add significant high-energy, small-scale content to get realistic-looking turbulent flow. These same mechanisms are not utilized in the scientific computation of turbulence although there might be virtue in examining the deeper meaning.

 

Turbulence experiments are focused on mean flow especially for engineering purposes. The extremes and more esoteric aspects of the statistics of the flow are not typically important. For this reason flows that appear non-turbulent can meet quantitative criteria, but fail to look turbulent to the eye. On the other hand this is the essence of the difference between the judgments of the senses compared with the quest for scientific understanding. At some level the aspiration should be cast toward satisfying both goals.

 

frozen-snow-simulationThe bountiful success of CFD is do doubt in small part due to the appeal of visualizations. The problem comes when the use of computing becomes more about the appearance of the results than their scientific validity. In many cases the realistic appearance is all the proof needed to trust the results and little in depth analysis is done to establish the credibility of the calculations. This is a dangerous path to take especially as the role of computational simulation grows and the stake in its credibility similarly expands. The potential for misuse and disaster looms if the proper care and seriousness isn’t taken.

 

As technology advances, the ingenious ideas that make progress possible vanish into the inner workings of our machines, where only experts may be aware of their existence. Numerical algorithms, being exceptionally uninteresting and incomprehensible to the public, vanish exceptionally fast.

Nick Trefethen

 

While the beauty of the results has provided for easier and greater adoption of CFD as a stable of modern engineering, the lack of quantitative engagement with quality has left CFD stalled. The vast progress of the first couple of decades has been replaced with an acceptance of the status quo and a loss of innovation and improvement in capability. This process has in part cfd3allowed the unhealthy obsession with computing hardware to take root, while starving the algorithm and method development of support. The bigger, faster computer has become the lynchpin to any ability to compute while other means to improvement have languished.

 

This approach is leading to a hollowing out of the field, as more people are merely practitioners of codes with little or no understanding of how the calculations are done. In many cases the CFD codes are run by hacks that understand frightfully little about how the calculations are done, and the various pitfalls that await them. At the same time relatively primitive algorithms and methods are powering the CFD particularly in the case of commercial products. Powerful visualization, bigger computers, graphic user interfaces and a lack of real standards for computational quality allow all of this. We also have a managetumblr_mrs5twy2xO1qlwxteo1_500ment class who are susceptible to the shallow, deceitful
marketing practices and increasingly lack the technical knowledge and skill to even ask the right questions. We have allowed our scientific standards to slip dangerously low through the glossy seduction of colorful fluid dynamics.

 

Life is hard. It’s harder if you’re stupid.

John Wayne

 

At their core most commercial CFD codes are crap. I mean it; they are generally based on terrible methods. They have wonderful user interfaces, mesh generation and visualizationBqRp8HCIYAAjy8a capability, but their solvers are mostly ancient garbage. Most of them rely upon methods that are more than two decades old. Even then the methods were not the best available then, but instead chosen for “robustness” rather than accuracy. One is fortunate if they can find a reliable second-order discretization and the standards for solving nonlinear systems of equations are pathetic (the community accepts a nonlinear residual that is enormous!). Turbulence is modeled using old antiquated methods of similar vintage. Of course, the acceptance of this tertumblr_static_tumblr_static_982sepnf784c0ws04swc0ok8c_1280rible technology is aided by the relative lack of progress over the last couple of decades in no small part due to the shift in emphasis toward hardware and away from algorithms and methods. The real core of the problem is the willingness of the community to accept this crap as state of the art. Stunning visuals seal the deal and help craft the path toward mediocrity.

 

Without change something sleeps inside us, and seldom awakens. The sleeper must awaken.

― Frank Herbert

 

Colorful fluid dynamics should be an insult; instead it has become the path to professional success and stunted progress.

Newer posts →

Subscribe

  • Entries (RSS)
  • Comments (RSS)

Archives

  • February 2026
  • August 2025
  • July 2025
  • June 2025
  • May 2025
  • April 2025
  • March 2025
  • February 2025
  • January 2025
  • December 2024
  • November 2024
  • October 2024
  • September 2024
  • August 2024
  • July 2024
  • June 2024
  • May 2018
  • April 2018
  • March 2018
  • February 2018
  • January 2018
  • December 2017
  • November 2017
  • October 2017
  • September 2017
  • August 2017
  • July 2017
  • June 2017
  • May 2017
  • April 2017
  • March 2017
  • February 2017
  • January 2017
  • December 2016
  • November 2016
  • October 2016
  • September 2016
  • August 2016
  • July 2016
  • June 2016
  • May 2016
  • April 2016
  • March 2016
  • February 2016
  • January 2016
  • December 2015
  • November 2015
  • October 2015
  • September 2015
  • August 2015
  • July 2015
  • June 2015
  • May 2015
  • April 2015
  • March 2015
  • February 2015
  • January 2015
  • December 2014
  • November 2014
  • October 2014
  • September 2014
  • August 2014
  • July 2014
  • June 2014
  • May 2014
  • April 2014
  • March 2014
  • February 2014
  • January 2014
  • December 2013
  • November 2013
  • October 2013
  • September 2013

Categories

  • Uncategorized

Meta

  • Create account
  • Log in

Blog at WordPress.com.

  • Subscribe Subscribed
    • The Regularized Singularity
    • Join 55 other subscribers
    • Already have a WordPress.com account? Log in now.
    • The Regularized Singularity
    • Subscribe Subscribed
    • Sign up
    • Log in
    • Report this content
    • View site in Reader
    • Manage subscriptions
    • Collapse this bar
 

Loading Comments...