TIL there actually is something called "no free lunch in search and optimization"[1].
See however that the theorem is quite weak. Requires eg the assumption that the search space has no structure. They even have the example of quadratic problems. It's mostly a useless saying, it appears to me.
See however that the theorem is quite weak. Requires eg the assumption that the search space has no structure. They even have the example of quadratic problems. It's mostly a useless saying, it appears to me.
[1] https://en.m.wikipedia.org/wiki/No_free_lunch_in_search_and_...