• About The Regularized Singularity

The Regularized Singularity

~ The Eyes of a citizen; the voice of the silent

The Regularized Singularity

Monthly Archives: October 2014

Difficulties are Opportunities

31 Friday Oct 2014

Posted by Bill Rider in Uncategorized

≈ Leave a comment

A pessimist sees the difficulty in every opportunity; an optimist sees the opportunity in every difficulty.

― Winston S. Churchill

imagesThere seems to be a pervasive attitude that difficult things should be avoided and any difficulty is treated as an approximation to failure. I have had this theme play out repeatedly this week where something difficult is ta  ken as tantamount to failing. For someone looking to grow, and excel, difficult work is the chance to improve through stringent testing. Difficulty should stir one to the core and call them forward toward achievement. The worst thing is the inability to see the opportunity being granted, most of our best, strongest attributes were forged in our most difficult moments.

There is no failure except in no longer trying.

― Elbert Hubbard

Of course, the prevailing culture today does little to help. The lack of faith in humanity exhibited by the implied lack of trust rewards the overly cautious with stability and comfort. We have gotten into a habit where the mediocre status quo is greeted as success. People are rewarded for not rocking the boat, not being critical and most of all not raising difficult issues. We are taught to get alone, kick the can down the road and not make waves. This approach will only assure that we as a nation become a monument to delusional success when we have become distinctly milquetoast.

images-1Problems are seen when work that should have done years ago is missing. Instead it is the opportunity to do meaningful, interesting and important work that fills in an essential gap. In another case a procedure was found to be lacking, which turned out to be embarrassing. Instead it is a reward of due diligence and points toward a higher future standard, but also toward important shortcomings in tools used. These tools will require substantial effort to make better. We see to have created a system that tells us that these cases should be avoided. Instead they need to be celebrated as opportunities for interesting and necessary work that will stretch the capabilities of the lucky people doing the work.

Our most significant opportunities will be found in times of greatest difficulty.

― Thomas S. Monson

UnknownThis is quite sharply related to the absolute intolerance for anything that could be interpreted as failure. Failure brings the possibility of rebuke and scandal. The lessons of almost every success has been lost in the process, to achieve greatness, risk must be taken, and risk entails the possibility of failure. We are avoiding short-term pain and the cost of long-term success, which will manifest itself as a decline toward inevitable mediocrity.

What seems to us as bitter trials are often blessings in disguise

― Oscar Wilde

The Real Test

30 Thursday Oct 2014

Posted by Bill Rider in Uncategorized

≈ 1 Comment

In preparing for battle I have always found that plans are useless, but planning is indispensable.

― Dwight D. Eisenhower

UnknownWhat is a “real” test? I will submit that it is what happens when something different than what you prepared for. If we are at our best, we will plan ahead and test ourselves to prepare for the future. Reality always manages to throw more at us that we anticipate. The same can be said for theory, computing and experiment. Science is empowered by the unexpected and should be embraced. Too often the unexpected event or failure is viewed negatively, but instead it should be embraced as an opportunity.

 Life always begins with one step outside of your comfort zone.

― Shannon L. Alder

We prepare for life and test ourselves, but the real test is when something unexpected happens. I always view myself as being in constant improvement mode. Sometimes events hit me in an unexpected way. When I don’t react well, it provides me the feedback that perhaps I should rethink my preparation a bit. I’m missing so things, or perhaps I let emotion cloud my response. The point is that I’m not perfect and never will be. Again, science, theory and models are much the same, imperfect and tend to buckle under use under unforeseen circumstances.

In science if you know what you are doing you should not be doing it.

In engineering if you do not know what you are doing you should not be doing it.

Of course, you seldom, if ever, see the pure state.

– Richard Hamming

Not-just-fail-but-epic-failIn a similar vein we test our codes. For a good professional code there will be an immense number of tests executed and potentially a sizable team involved in testing the code. Nonetheless, the code will break with almost certainty because it will be used in innovative ways not foreseen by the developers or testers. The real test is when the code is used for something we didn’t anticipate. Then we find out how good it really is. As usual the problems that arise are usually viewed as failures rather than opportunities. We should endeavor to view this differently; these failures are the opportunity to take the code to the next level of performance.

But words in a book were one thing. The true test came in battle.

― George R.R. Martin

Failure is a good thing. Too much of modernity has deemed failure as unacceptable, but without failure true excellence in unachievable.

Only those who dare to fail greatly can ever achieve greatly.

― Robert F. Kennedy

Simplify, simplify,..

29 Wednesday Oct 2014

Posted by Bill Rider in Uncategorized

≈ Leave a comment

Unknown

Make everything as simple as possible, but not simpler.

―Albert Einstein

davinciSimplicity is the ultimate sophistication.

― Leonardo da Vinci
For many reasons simplicity is valued greatly, some good, some not so much. Given the above stated endorsement of simplicity by two of the greatest minds in human history, more consideration of this principle is warranted. It is worth thinking about when simplicity should be sought over the creeping tendency towards complexity. Often the simple explanation for complex phenomena is the stroke of genius because it contains the kernel of utility. We typically see simplicity that is good as elegance and grace where a cacophony of complexity might otherwise reign.

Simplicity is a great virtue but it requires hard work to achieve it and education to appreciate it. And to make matters worse: complexity sells better.

― Edsger W. Dijkstra

By the same token simplicity can also be bad. Simplicity can be terrible when it coincides with a lack of consideration of a complex situation. Without the stroke of genius, the simplicity can simply be a lazy approach where an easy solution is taken that misses the essence of a problem. In this sense the word simple is woefully inadequate to capture the aspects of quality necessary for a discerning eye. For this reason when genius isn’t present, complexity often rules, it at least shows consideration of the details even if it is lost in them

occams-razorThe heuristic of Occam’s razor comes in as a principle to clarify things. At its simplest it specifies a tendency for choosing between explanations based on their relative simplicity; if they are otherwise equal, the simplest explanation is preferred. One might be properly tempted to apply the same principle, but replace “simple” by “elegant,” “beautiful” or “graceful”. This gets to the core of the manner in which science takes on the mantle of an art; beauty, elegance and grace have a roll to play in shaping opinions.

 Any darn fool can make something complex; it takes a genius to make something simple.

― Pete Seeger

SphericalCow2One could easily take the view that this is a bad thing, but the concepts of artistic opinion are useful. These concepts capture the deep essence of the subconscious. The subconscious is integrating many factors that hidden from the superficial thinking usually operating in people. We know beauty and elegance when we see it, and we naturally gravitate toward it. Unfortunately these also include bias and preconceptions that would tend to hold progress back. Given this possibility the whole artistic approach to science needs to be taken in a mindful fashion fully acknowledging the tendency to give into traditional bias and counter-balancing this trend with careful consideration of alternatives. This is where Occam’s razor and attractiveness of simplicity can play a deeply powerful roll in progress.

Nature has a great simplicity and therefore a great beauty

― Richard P. Feynman

Despite our desire to ascribe truth and logic to science, it remains a fundamentally human endeavor, and as such prone to humanity’s frailties. There is nothing wrong with stepping forward fully aware of this; there is something wrong with not acknowledging the roll of opinion and art in what science accomplishes.

Our life is frittered away by detail. Simplify, simplify.

― Henry David Thoreau

 

We have a lot to fear from fear itself.

28 Tuesday Oct 2014

Posted by Bill Rider in Uncategorized

≈ Leave a comment

The only thing we have to fear is fear itself.

― Franklin D. Roosevelt

One doesn’t need to look very hard to see that America is ruled by fear today. The media, industry and politicians have learned how to wield fear to gain money and Unknownprofit. Americans have bought into the fear-based culture fully. Mass media and particularly the news media have learned that fear sells and drives profits. Industry plays upon peoples deepest fears to sell products whether the fear is cultural, physiological or subliminal it drives sales.

If you want to control someone, all you have to do is to make them feel afraid.

― Paulo Coelho

No one uses fear more than politicians. The political ads are almost completely fear-Unknown-1based because nothing drives the people to the polls like fear. Fear of immigrants, loss of jobs, terrorism, Ebola, and most of all the loss of the America of memory is a reason to fear. The result is fear-driven policy. Our government is rife with fear-based, counter-productive laws and governance. Government institutions are driven by fear. As just one example air travel is teeming with stupid fear-based practices.

The worse thing is that courage has no value. We have gone from the “Greatest Generation” to a bunch of sniveling cowards. Of course on of the largest penalties we pay from this fear is the loss of leadership as a Nation. Through the use of fear as a political tool all hope of leadership is cast aside. One does not lead through fear, one rules, one subjugates. Today Americans are subjugated through a tyranny of fear and ultimately a prison of their own making. We have become a cowering mass looking to our Nation to protect us from the numerous “boogie-men” created to shackle us.

Nothing in life is to be feared, it is only to be understood. Now is the time to understand more, so that we may fear less.

― Marie Curie

Fear is the main source of superstition, and one of the main sources of cruelty. To conquer fear is the beginning of wisdom.

― Bertrand Russell

What we need is so leadership that looks to our challenges and pushes us to overcome them. We need leadership that says we can use wisdom and achievement to defeat our adversaries. We need leadership that urges us to either not be afraid or face our fears. We need leadership that is actually proud of our Nation and people rather than pandering to their basest reactions. Many of the fear that is most effectively channeled are deep-seated bigotry based on a changing World. We need leaders who embrace change as opportunity and strive to make the future better. Keeping the future as a hollow version of the past through bias, bigotry and fear is simply playing to worst of humanity’s traits. We need leadership that urges us to accentuate the best in fellow citizens and ourselves.

isisTake the threat of ISIS (ISIL). Are they really a threat? Really? A bunch of poorly educated barbarians half a world away? No they aren’t. Man the hell up, what sort of wimps have Americans become? They are a bunch of idiotic zealots that represent no threat at all to our Country. They are bad people that the World needs to manage, but not an actual threat. The actual threat is to our tax dollars. ISIS is another convenient threat used by the politicians and the military-security-industrial complex to drive money into their pockets. Nothing more.

Unknown-2This is just the tip of the iceberg in imaginary threats that Americans are allowing to rule their lives. Ebola is another great example. All we need is competence and it offers no threat. My only fear is that we can’t muster competence any more.

I learned that courage was not the absence of fear, but the triumph over it. The brave man is not he who does not feel afraid, but he who conquers that fear.

― Nelson Mandela

Along with leadership we need to embrace knowledge and understanding. This comes from a host of sources including the hard sciences as well as social science. The irony is that the USA has become the fear-based society running more on superstition than rational thought. We need to reject these irrational reasons for doing things. The Nuclear.power.plant.Dukovanyrejection of rationality is not a left or right characteristic; it has become an American characteristic. Whether it is climate change, diseases (e.g., Ebola), nuclear power, vaccines, GMO and a host of other scientific or technological questions Americans are irrational. We have become governed by hoax and conspiracy rather than truth, trust and logic.

 He who has overcome his fears will truly be free.

― Aristotle

A holistic view of attending conferences

27 Monday Oct 2014

Posted by Bill Rider in Uncategorized

≈ 1 Comment

The most important thing in communication is to hear what isn’t being said.

– Peter Drucker

Last week I attended a conference in Los Alamos, the ominous sounding NuclearCoffee4 Explosives Code Development Conference. I can’t make the usual sort of summary of a meeting that I’d ordinarily write about, but I will offer a few high level comments. There certainly were some memorable talks during the week. They offered some great new ideas in computational physics or a much needed progress report on important work.

 Strength lies in differences, not in similarities

― Stephen R. Covey

As an example a Los Alamos group is working on an interesting multiscale method that offers the combination of increased computational efficiency and better answers in one Unknowntidy package. Lawrence Livermore showed some really interesting efforts in several areas including advanced shock hydrodynamic methods using high order methods, and progress on an age old problem of combining particles with interface tracking. Despite these highlights among others, the best and most important thing about the meeting was what happened when talks were not being given.

Over coffee and snacks, at lunch, or at dinner we all ate, drank and talked together about the challenges our community faces. In addition we had the opportunity to meet new people, catch up with old friends and have deep conversations about everything going on in the community. Nothing compares to the sort of exchange that you can have face-to-face in the flesh. Electronic communication is no substitute. For a reception toast_5community that doesn’t have the full breadth of modern communication available to it due to security concerns it is even more important. Even then the human connection and social construct of “breaking bread” cannot be replicated. No technological advance can change the importance of that dynamic. Outside of work hours at dinner or over drinks, you can get to know people far better, and exchange frank comments, tell stories and help build community.

Social capital may turn out to be a prerequisite for, rather than a consequence of, effective computer-mediated communication.

― Robert D. Putnam

The only problem with this is the limits and paperwork the government is putting on conference attendance. The meeting as a result is smaller than it should be and the impact on the community loses some of its power to make things better. These meetings are unique opportunities to get everyone on the same page, and surface important issues. The cost to the community is far greater than any amount of money that is saved by the current policy.getty_rf_photo_of_colleagues_sharing_a_beer

With the extreme challenges facing us in terms of the long-term prospects for stewardship without testing coupled to changes in computing, the community needs all the unity it can get. The challenges we face are immense. As a matter of fact the challenges are probably even greater than commonly acknowledged. A poorly attended meeting is lost opportunity and an unnecessary impediment to progress.

Before you become too entranced with gorgeous gadgets and mesmerizing video displays, let me remind you that information is not knowledge, knowledge is not wisdom, and wisdom is not foresight. Each grows out of the other, and we need them all.

― Arthur C. Clarke

 

Indispensible Apps

26 Sunday Oct 2014

Posted by Bill Rider in Uncategorized

≈ Leave a comment

UnknownUnknown-3 Unknown-2 Unknown-1

Which of us can resist the temptation of being thought indispensable?

― Margaret Atwood,

Evernote Camera Roll 20141026 65626

Evernote Camera Roll 20141026 065625Evernote Camera Roll 20141026 065749

 

 

 

 

In the past year I’ve fully embraced the online world. This is in a lot more ways than just writing a blog, tweeting etc. My most used programs have changed from the standard laptop, desktop applications like Microsoft office to a set of mobile apps: Evernote, Pocket, Zite and recently Wunderlist. I’m finding the apps to be indispensible, and hope they can make me more capable of working effectively. It also helps the ability to balance things between work and home.

Best of all these apps work together and run across multiple platforms. Evernote is the hub, but all of them add a lot of value to my day.

Be infinitely flexible and constantly amazed.

― Jason Kravitz

Evernote is the definitely the flagship app for me. If you’re not familiar with it, Evernote Camera Roll 20141026 064813Evernote is an electronic filling cabinet. It ends up being the clearinghouse for information flowing from all these other apps and more. Evernote also runs on every platform (phone iPhone/Android, laptop, desktop, iPad, and web). You can always get your data. My wife uses it at her office as the common system for managing multiple accounts able to deal with data from many sources.

Evernote Camera Roll 20141026 065040I use it to jot down ideas, plan writing assignments, take notes at meetings, save articles, and keep a food, exercise, and personal journal. It can accept info in almost any format and allows you to write notes, and draw graphical comments inside most. It also has a fantastic web clipper that allows me to save web pages directly plus add comments. Another great thing to do is use Evernote to save business cards, travel cards, and other documents that pile up in wallets, or get easily lost. I’ve also used it for saving details of medical appointments, and repair/remodel work at home. It’s the place where I store the details of my referee assignments for soccer as well as notes on the games for future reference.

Evernote-Window copy

It is really appropriate to use the overused word, awesome, to describe it. Evernote is awesome and utterly indispensible. If you haven’t tried it you should.

Wunderlist-screen copyNext is the most recent addition to my staple of mobile apps, Wunderlist. Wunderlist is a to do and task manager. I’ve added it because it is multiplatform. I can have a uniform and synched list across mobile, laptop and desktop apps. I have a set of things that I want to accomplish every day, which repeat along with a set of single use items. All of them can be tracked and dealt with. It is still being tried out, but it’s almost sure that it will be a keeper.

The last two apps are Pocket and Zite, which work hand-in-hand. pocketscreen copy 2Pocket is a way of saving almost anything to read. I use it mostly for web articles to read later, mostly while exercising at the gym. It can also save files from multiple formats. The best thing is that it works automatically from web browsers, and other apps. I can also push the articles directly to Evernote if I really like it! Pocket also has an archive of its own to save things for the long term.

Evernote Camera Roll 20141026 065039 Evernote Camera Roll 20141026 064814

Zite is a way of reading online content. It takes the top articles from multiple sources and making it available for viewing. Often I’ll find interesting things and saving it for later reading in Pocket. I get to choose what I’m interested in and Zite collates the top articles in each area for me to see. It also puts everything together for a list of the top, top stories in my interest list. The only downside to Zite is its unavailability on laptops, desktops and web browsers. I do wish it were more available on all my platforms. On my mobile platforms it is right near the top of my use.

The only way to get what you’re worth is to stand out, to exert emotional labor, to be seen as indispensable, and to produce interactions that organizations and people care deeply about.

― Seth Godin

These apps have made me more productive and well informed. Maybe they could help you too.

The Good Ole Days

24 Friday Oct 2014

Posted by Bill Rider in Uncategorized

≈ Leave a comment

This week I attended a Unknownconference in Los Alamos. It is difficult to not be nostalgic having worked there for 18 years. It harkens to the old saw that people tend to pull out, “those were the good ole days”. What if they were? Why aren’t things getting better?

I will submit that one of my observations this week is that I remember the good far more than the bad. I am not alone in that tendency.

Remembrance of things past is not necessarily the remembrance of things as they were.

― Marcel Proust

First, some things are getting better. I’m shamelessly progressive and love the benefits of discoveries in science; technology and medicine that make life better in many ways. Medical treatments make once fatal conditions, trivial to treat. For example I had a minor congenital defect that would have proved fatal a few decades before, and was treated by a simple surgery when I was a month old.images-3The Internet, Google, smartphones, instant messaging and a host of other miracles make our lives better in many ways. I used to spend hours in the Los Alamos Lab library doing research; copying papers where today I could do even more from home or my office with almost everything being available as a PDF. Some of the collateral consequences are problematic, but I have faith that a happy equilibrium will be achieved.

What you end up remembering isn’t always the same as what you have witnessed.

― Julian Barnes,

In Los Alamos with dead certainty there were the good ole days. The past was imagesdramatically better. The Lab was better, working conditions were better and the Lab’s work meant something to the Nation. With Los Alamos it is almost a fait accompli with its role in World history guaranteeing a downhill slide over time. Nonetheless, Los Alamos continued to make history for its first twenty years or so, before decay set in. Of course, its origin included a host of future Nobel Laureates, and a job of monumental gravity. The success played a key roll in shaping the remainder of the 20th Century.

images-1The issues dragging Los Alamos down go well beyond local conditions. Ultimately, with the end of the Cold War the Nation as well as Los Alamos has lost its bearings. We continue to move down a path where any sense of deeper meaning is hard to find in the lives we live. The almost systematic destruction of the middle class seems to go hand-in-hand. It is as if the powers that be were working to assure that most people’s lives are spent in pursuit of survival rather than the achievement of aspirational goals. Our systems are in deep decline and no one seems to be able to muster enough vision and leadership to see a way out.

In this context the old saw of the “good ole days” is appropriate and correct.

It is strange how we hold on to the pieces of the past while we wait for our futures.

― Ally Condie

Excellence and Accountability

23 Thursday Oct 2014

Posted by Bill Rider in Uncategorized

≈ 1 Comment

Management is doing things right; leadership is doing the right things.

–Peter Drucker

Once upon a time the National Labs were paragons of excellence in science and Unknownengineering. No more. Over time the Nation has demanded that the Labs become paragons of accountability. The over-emphasis on accountability has ironically worked to drive excellence from the Labs. In an accountability-driven culture if no one is accountable for excellence, excellence dies. This is a direct consequence of our current over-managed and under-led status both locally and nationally.

Efficiency is doing things right; effectiveness is doing the right things.

–Peter Drucker

Today no one focuses on excellence except through a host of metrics that only give a shadow imprint of excellence. All the while a culture of excellence is not cultivated at all. Rather than do the things that lead to excellence, the culture of accountability acts to undermine it. Staff will avoid going to seminars or classes that would develop them professionally for the long-term because their current projects won’t pay for Pert_example_gantt_chartthem. Continually the projects drive the staff to think only in a short-term tactical project-focused manner despite the damage done to their long-term development.

Consider attendance at a conference, which has become extensively scrutinized lately. CUWP-3Almost any conference I attend is a broad-brushed opportunity to develop professionally across a suite of projects present and future. The accountability culture only cares about what I am presenting, but nothing about what is presented to me. In other words attending a conference is all about what is the attendee is presenting.
The reality should be balanced between what is given and what is received. A large part of a conference is the exposure to new ideas, the current focus of a community and networking with other attendees. In fact most of the benefit has nothing to do with the reason given for attending. The culture of accountability misses the key points. A culture of excellence would have no problem is accommodating the proper perspective.

The explicit drive for excellence and professionalism has been destroyed by the “customer is always right” attitude. My experience is that the customer is almost always wrong, and could greatly benefit from treating the Labs as reservoirs of expertise that could greatly improve their judgment. Too often today the customers are simply taking knowledge and products from the Labs while doing little or nothing to support the foundation that created the expertise. As such the expertise is running dry, if the well of knowledge is not sustained it will die. Our current customer-focused accountability culture is hopelessly shortsighted. There is little or no focus on the long-term development of the Labs expertise. The research is becoming ever more customer-focused and tactical. The investments in long-term sustaining research are minimal in large part because the “customer” receives no perceived benefit in the short term. All the while the customers are happy to siphon off benefit from the expertise they do little to sustain.

Of course this entire philosophy gets the core of the problem. The lack of a broad-based societal imperative for supporting the development of societal expertise is troubling. This is in contra-distinction to the events following World War II when the system of National Laboratories came into existence. The benefits of the expertise were felt across the Nation and World and usually beyond the direct impact on the agency that sponsored the Lab. Quite often the Energy or Defense or NASA Lab produced breakthroughs that impact the work of the other Labs or industries. The benefit quite often spilled over into other activities such medicine or industrial production. Computing is the archetype of this cross-fertilization. Computing’s various breakthroughs came from numerous fields and ultimately spurred the creation of a massive industry. No system of accountability could have been responsible for what happened, it was the product of broad-based excellence in science. I would submit that the current short-term culture of accountability would have likely short-circuited the entire thing. I worry that our focus on accountability is probably undermining our future prosperity already.

A primary task of management in the developed countries in the decades ahead will be to make knowledge productive.

–Peter Drucker

The result is the nearly systematic destruction of an essential National resource. T2000px-Scrum_process.svghe true irony is that no one is accountable for this act violence against our National security. In fact it is hidden behind a veil of accountability standards that provide the façade that everything is being done well. We only assure that the terrible things are done efficiently. A large part of the devotion to accountability is couched in fear and suspicion. Excellence is founded on hope and trust guided by principle.

 There is nothing quite so useless as doing with great efficiency something that should not be done at all.

–Peter Drucker

 The same thing is happening at Universities across the country too. The educational aspect of a university is the epitome of excellence, and any observation of the value system in place shows unequivocally that teachisingapore_lecture_bishopng has less value than research. Our students are not simply burdened by student loans and the concomitant debt, but also by increasingly poor instruction. They are getting a worse education at a substantially higher price. At the core of the problem is money. Less societal support for education is driving universities to focus on research grants as a source for money along with the student loans. The grants drive emphasis from teaching and push a variety of inappropriate foci such as research associates, post-docs as labor, and adjunct professors as cheap teacher (adjuncts are another key measure of the value placed in teaching, which ain’t much!).

The combined effect of the erosion of excellence in Labs and Universities is hurting our Nation’s prospects for the future. No amount of accountability can fix this. Only by backing away from the current shortsighted philosophy can we recapture the excellence that once exemplified these institutions. It will require us to do a number of things we have lost sight of including long-term goals, trust for our fellow citizens, and the belief that we have things worth working together toward.

What gets measured gets improved.

–Peter Drucker

The Swirlier the Flow is, the Better, Right?

22 Wednesday Oct 2014

Posted by Bill Rider in Uncategorized

≈ 2 Comments

The purpose of computing is insight, not pictures.

–Nick Trefethen
This is a brief take on the intersection of a couple of previous posts: the recent one on the viewgraph norm (https://williamjrider.wordpress.com/2014/10/07/the-story-of-the-viewgraph-norm/), colorful fluid dynamics (https://williamjrider.wordpress.com/2014/10/03/colorful-fluid-dynamics/), the Millennium prize for the Navier-Stokes equations (https://williamjrider.wordpress.com/2014/03/07/the-clay-prize-and-the-reality-of-the-navier-stokes-equations/), and numerical viscosity (https://williamjrider.wordpress.com/2013/10/04/there-is-nothing-artificial-about-artificial-viscosity/).Kelvin-Helmholtz_Instability.ogv

The basic view of quality is predicated on the belief that more “energy (disorder)” and complexity in the computed flow is directly correlated to the quality of the computation. This is typically applied in an intrinsically ad hokh-instabilityc manner that may not actually provide an accurate assessment of quality. At some point the disorder in the computation is too great and the quality is judged to be lower. This is done purely by expert judgment, not based on any sort of clear definitive measure or feature. The real issue is whether the computation is swirlier due to incipient errors that are on the verge of losing stability. This may inadvertently favor instability in the numerical method point-of-view (in fact, almost certainly).

There are three great branches of science: theory, experiment, and computation.

–Nick Trefethen,

cyl_vort_editThis topic involves deep-seated issues with each of these branches.

As soon as a fluid flow becomes unstable and vortically dominated the knowledge of the exact solution is absent. These flows are exceedingly important thus the quality of calculations is extremely interesting, but difficult-to-impossible to specifically determine. At the heart of the issue is the lack of theoretical grasp of turbulent flows. This is a fundamental limitation on our ability to reliably compute the behavior of real fluids and correspondingly determine the quality of computing methods. This in turn leaves us with the current state of affairs swirlier is better.

I became most troubled by this aspect of the determination of quality after seeingswirly2 a standard applied, which amounts to “the more swirly the result, the better the method” (more swirly means more vorticity). An exemplar of this approach is the paper by Shi, Zhang and Shu in the Journal of Computational Physics, 186, pp. 690 (1993) http://www3.nd.edu/~yzhang10/euler-weno9.pdf. Several problems are studied using mesh refinement (good!) including shock-driven mixing and Kelvin-Helmholtz, and Rayleigh-Taylor instabilities with high-order methods. The conclusion is that the higher order methods are better because they produce more fine scale structure.

Swirly1My concern about this issue is that the higher order methods also contain insidious and problematic numerical instabilities that could potentially contribute to physically incorrect solutions. The current “swirlier is better” standard yields little or no guidance towards improving the methods or uncovering their shortcomings. The problems with these methods can manifest themselves as entropy violating solutions, which are by definition unphysical. An unphysical solution will produce more vorticity, and hence be swirlier by the standard applied in the community; it would be viewed as better. In fact it would be worse and dangerously so.

In chaos, there is fertility.

― Anaïs Nin

Why does this standard exist?

The use of the first-order upwind method historically produced too much numerical dissipation. Upwind methods were robust enough to be used for applications, images-1 copy 5but also had large errors. These errors led to the destruction of vorticity, which made flows distinctly less swirly than reality. Modern methods provided the robustness of upwind methods with much smaller error, and much more realistic swirliness. The problem is that instabilities can lead to swirliness too and this standard leaves no room for determining the limits for methods. This is left for validation against experimental data. This is thoroughly unsatisfying because there is not a mathematical ground truth. Modeling and numerical effects are muddled together. Unfortunately, mathematics is not currently attacking this problem very aggressively (see my Applied Math critique https://williamjrider.wordpress.com/2014/10/16/what-is-the-point-of-applied-math/). In truth, the mathematics to address this issue is not presently sufficient.

images copy 9What can be done to improve matters? One way would be to rely upon experimental comparison to decide quality. This leaves little guidance for improving the methods based on mathematical principles. Insofar as applied mathematics is concerned, a better theory for the development of these instabilities would enable guidance toward better methods. This is lacking today rather seriously. It would be useful to have a refined understanding of what unphysical solutions look like for these cases. Today such a characterization is not available to be applied. We are left with experimental comparison and/or expert judgment.

All that it is reasonable to ask for in a scientific calculation is stability, not accuracy.

–Nick Trefethen

Compute What Should Be Computed

22 Wednesday Oct 2014

Posted by Bill Rider in Uncategorized

≈ Leave a comment

Measure what can be measured, and make measurable what cannot be measured.

― Galileo Galilei

A modification of this famous quote was the title of an interesting paper I read on compressed sensing a couple of days ago, “Measure what should be measured”. In today’s world of data explosion it is a curious statement. The real thing that might apply is “measure everything, look at what is important”. This might have real application to control the expansion of data. Compressed sensing might have a great deal to say about how to do this.

I started thinking about computing. What do we do today, do we simply “compute what can be computed”? Shouldn’t we be “computing what should be computed”? or better yet compute what is important. Like data, we perhaps will “compute everything and look at what is important”. Again, the philosophy and methodology of compressed sensing might apply to getting there.

One route is efficient, but extremely difficult, while the other is wasteful and potentially tractable. Something needs to happen, the future of computing depends on the answer.

← Older posts

Subscribe

  • Entries (RSS)
  • Comments (RSS)

Archives

  • February 2026
  • August 2025
  • July 2025
  • June 2025
  • May 2025
  • April 2025
  • March 2025
  • February 2025
  • January 2025
  • December 2024
  • November 2024
  • October 2024
  • September 2024
  • August 2024
  • July 2024
  • June 2024
  • May 2018
  • April 2018
  • March 2018
  • February 2018
  • January 2018
  • December 2017
  • November 2017
  • October 2017
  • September 2017
  • August 2017
  • July 2017
  • June 2017
  • May 2017
  • April 2017
  • March 2017
  • February 2017
  • January 2017
  • December 2016
  • November 2016
  • October 2016
  • September 2016
  • August 2016
  • July 2016
  • June 2016
  • May 2016
  • April 2016
  • March 2016
  • February 2016
  • January 2016
  • December 2015
  • November 2015
  • October 2015
  • September 2015
  • August 2015
  • July 2015
  • June 2015
  • May 2015
  • April 2015
  • March 2015
  • February 2015
  • January 2015
  • December 2014
  • November 2014
  • October 2014
  • September 2014
  • August 2014
  • July 2014
  • June 2014
  • May 2014
  • April 2014
  • March 2014
  • February 2014
  • January 2014
  • December 2013
  • November 2013
  • October 2013
  • September 2013

Categories

  • Uncategorized

Meta

  • Create account
  • Log in

Blog at WordPress.com.

  • Subscribe Subscribed
    • The Regularized Singularity
    • Join 55 other subscribers
    • Already have a WordPress.com account? Log in now.
    • The Regularized Singularity
    • Subscribe Subscribed
    • Sign up
    • Log in
    • Report this content
    • View site in Reader
    • Manage subscriptions
    • Collapse this bar
 

Loading Comments...