16 comments

  • geokon3 hours ago
    On thing that is often overlooked but should be emphasized is that the considered frequencies are fixed values while the phase shifts are continuous values. This creates tons of downstream problems<p>If your underlying signal is at frequency that is not a harmonic of the sampling length, then you get &quot;ringing&quot; and it&#x27;s completely unclear how to deal with it (something something Bessel functions)<p>Actually using DFTs is a nightmare ..<p>- If I have several dominant frequencies (not multiples of the sampling rate) and I want to know them precisely, it&#x27;s unclear how I can do that with an FFT<p>- If I know the frequency a priori and just want to know the phase shift.. also unclear<p>- If I have missing values.. how do i fill the gaps to distort the resulting spectrum as little as possible?<p>- If I have samples that are not equally spaced, how am I supposed to deal with that?<p>- If my measurements have errors, how do I propagate errors through the FFT to my results?<p>So outside of audio where you control the fixed sample rate and the frequencies are all much lower than the sample rate... it&#x27;s really hard to use. I tried to use it for a research project and while the results looked cool.. I just wasn&#x27;t able to backup my math in a convincing way (though it&#x27;s been a few years so I should try again with ChatGPT&#x27;s hand-holding)<p>I recommend people poke around this webpage to get a taste of what a complicated scary monster you&#x27;re dealing with<p><a href="https:&#x2F;&#x2F;ccrma.stanford.edu&#x2F;~jos&#x2F;sasp&#x2F;sasp.html" rel="nofollow">https:&#x2F;&#x2F;ccrma.stanford.edu&#x2F;~jos&#x2F;sasp&#x2F;sasp.html</a>
    • hasley2 hours ago
      FFT&#x2F;DFT is not precise if you do not have the exact harmonic in you signal. If you are also (or only) interested in phases you might use a maximum likelihood estimator (which brings other problems though).<p>And as the previous answer said: compressed sensing (or compressive sensing) can help as well for some non-standard cases.
      • geokon9 minutes ago
        Do you have any good reference for compressed sensing?<p>The high level description on wikipedia seems very compelling.. And would you say it&#x27;d be a huge task to really grok it?
    • NL8072 hours ago
      Somewhat related field, compressive sensing, attempts to answer some of those questions (particularly missing data, uneven sampling and errors) using a L1 minimisation technique.
      • geokon8 minutes ago
        Can you recommend where to learn more about it? It looks like what I should be looking at.. hopefully not a rabbit hole :))
  • vismit200019 minutes ago
    This is the best content on this topic - a 2023 video by Reducible: <a href="https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=yYEMxqreA10" rel="nofollow">https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=yYEMxqreA10</a>
  • hasley2 hours ago
    I have not read the whole article. But, what is shown at the beginning is not the Fourier Transform, it is the Discrete Fourier Transform (DFT).<p>Though the DFT can be implemented efficiently using the Fast Fourier Transform (FFT) algorithm, the DFT is far from being the best estimator for frequencies contained in a signal. Other estimators (like Maximum Likelihood [ML], [Root-]MUSIC, or ESPRIT) are in general far more accurate - at the cost of higher computational effort.
    • casparvitch1 hour ago
      Not a particularly fair comparison, the DFT is a non-statistical operation.
      • hasley33 minutes ago
        Why do you think, that it is not fair?<p>You can even use these algorithms with a single snapshot (spatial smoothing).
  • dmd9 hours ago
    The absolute best teaching of the Fourier transform I&#x27;ve ever encountered is the extremely bizarre book &quot;Who is Fourier?&quot;<p><a href="https:&#x2F;&#x2F;www.amazon.com&#x2F;Who-Fourier-Mathematical-Transnational-College&#x2F;dp&#x2F;0964350408" rel="nofollow">https:&#x2F;&#x2F;www.amazon.com&#x2F;Who-Fourier-Mathematical-Transnationa...</a>
  • freshtake9 hours ago
    If you&#x27;re only interested in the gist of the concept and how it can be applied to compression, without the mathematical rigor, here is my go to: <a href="https:&#x2F;&#x2F;bertolami.com&#x2F;index.php?engine=blog&amp;content=posts&amp;detail=the-fourier-colada-analogy" rel="nofollow">https:&#x2F;&#x2F;bertolami.com&#x2F;index.php?engine=blog&amp;content=posts&amp;de...</a>
  • arialdomartini8 hours ago
    Brilliant!<p>I would just suggest the author to replace the sentence “99% of the time, it refers to motion in one dimension” with “most of the time” since this is a mathematical article and there’s no need to use specific numbers when they don’t reflect actual data.
  • devanshp8 hours ago
    It&#x27;s quite interesting that our ears implement a better-than-Fourier-like algorithm internally: <a href="https:&#x2F;&#x2F;arxiv.org&#x2F;pdf&#x2F;1208.4611" rel="nofollow">https:&#x2F;&#x2F;arxiv.org&#x2F;pdf&#x2F;1208.4611</a>
    • gsf_emergency_67 hours ago
      Article on how this might work (nonlinearity)<p><a href="https:&#x2F;&#x2F;jontalle.web.engr.illinois.edu&#x2F;Public&#x2F;AllenSpeechProc08.pdf" rel="nofollow">https:&#x2F;&#x2F;jontalle.web.engr.illinois.edu&#x2F;Public&#x2F;AllenSpeechPro...</a><p>Note the two electric circuit models figs 3.2 &amp; 3.8
  • kens14 hours ago
    If you&#x27;re dealing with computer graphics, audio, or data analysis, I highly recommend learning Fourier transforms, because they explain a whole lot of things that are otherwise mysterious.
  • analog3115 hours ago
    My only quibble is that the article is about the <i>discrete</i> Fourier transform.
    • shash12 hours ago
      It’s usually easier to explain the dft. and easier to do a periodic function than a totally arbitrary sequence.
      • krackers7 hours ago
        I&#x27;ve actually found the opposite, it&#x27;s easier to conceptually understand the continuous FT, then analyze the DTFT, DFT, and Fourier Series as special cases of applying a {periodic summation, discrete sampling} operator before the FT.
  • mohas2 hours ago
    Will I ever be able to learn the Fourier transform?
    • rkomorn1 hour ago
      Yes! Step 1 is forgetting about the name so it doesn&#x27;t feel as daunting.<p>Disclaimer: I&#x27;ve not actually done step 1, but I have more faith in you than in myself.
  • seam_carver10 hours ago
    If anyone wants to learn about the 2D DFT, the best explanation I&#x27;ve ever read was the relevant chapter in Digital Image Processing by Nick Efford.<p>If anyone wants to see my favorite application of the 2D DFT, I made a video of how the DFT is used to remove rainbows in manga on Kaleido 3 color eink on Kobo Colour:<p><a href="https:&#x2F;&#x2F;youtu.be&#x2F;Dw2HTJCGMhw?si=J6dUYOj2IRX1nPRF" rel="nofollow">https:&#x2F;&#x2F;youtu.be&#x2F;Dw2HTJCGMhw?si=J6dUYOj2IRX1nPRF</a>
    • brad09 hours ago
      In the video you show a 2D mask to blur diagonal lines. How is that mask applied to the DFT? Is the mask also converted to a DFT and the two signals get combined?
      • seam_carver6 hours ago
        Just remove anything under the mask basically, similar to a low pass filter.
  • biophysboy11 hours ago
    My favorite application of the Fourier transform is converting convolution into pointwise multiplication. This is used to speed up multiple sequence alignment in bioinformatics.
  • amarant3 hours ago
    I&#x27;ve decided math isn&#x27;t my thing. The first part of the article I couldn&#x27;t stop thinking &quot;how the hell would you construct a banana filter?&quot; And the entire smoothie metaphor seemed to describe nothing at all.<p>Then there was something about circles and why do some people call them some other silly thing?<p>So far, so utterly meaningless, as far as I could tell. just seemed like meaningless babble to make even a kindergartner feel comfortable with the article, but it didn&#x27;t seem to have communicated much of anything, really.<p>Then there were circles. Some of them were moving, one of them had a sinus wave next to it and some balls were tracing both in sync, indicating which part of the sinus wave equalled which part of the circle I guess?<p>I understood none of it.<p>I asked chat gpt to explain to me, i think it has read this article cause it used the smoothie analogy as well. I still don&#x27;t understand what that analogy is meant to mean.<p>Then finally I found this: If someone plays a piano chord, you hear one sound. But that sound is actually made of multiple notes (multiple frequencies).<p>The Fourier Transform is the tool that figures out:<p>which notes (frequencies) are present, and how loud each one is<p>That, finally, makes sense.
  • zkmon15 hours ago
    It is more about the duality between the amplitude and frequency spaces and conversion between them. A bit similar to Hadamard gate for transforming a quantum state from computational basis to diagonal basis.
  • kuharich15 hours ago
    Past comments: <a href="https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=38652794">https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=38652794</a>
  • constantcrying15 hours ago
    &gt;The Fourier Transform is one of deepest insights ever made.<p>No, it is not. In fact it is quite a superficial example of a much deeper theory, behind functions, their approximations and their representations.
    • fedsocpuppet14 hours ago
      The Fourier transform predates functional analysis by a century. I don&#x27;t see the point in downplaying its significance just because &#x27;duh it&#x27;s simply a unitary linear operator on L2&#x27;.
      • NewsaHackO13 hours ago
        But is it the deepest insights ever made?
        • badlibrarian12 hours ago
          The Fourier Transform isn&#x27;t even Fourier&#x27;s deepest insight. Unless we&#x27;re now ranking scientific discoveries based on whether or not they get a post every weekend on HN.<p>The FFT is nifty but that&#x27;s FINO. The Google boys also had a few O(N^2) to O(N log N) moments. Those seemed to move the needle a bit as well.<p>But even if we restrict to &quot;things that made Nano Banana Pro possible&quot; Shannon and Turing leapfrog Fourier.
          • lispisok10 hours ago
            &gt;Unless we&#x27;re now ranking scientific discoveries based on whether or not they get a post every weekend on HN.<p>Glad I&#x27;m not the only one who noticed there is a weekly (or more) post on what Fourier transform is.
            • chemotaxis3 hours ago
              It&#x27;s really getting in the way of all the daily AI opinion pieces I come here to read.<p>More seriously, there are tens of thousands of people who come to HN. If Fourier stuff gets upvoted, it&#x27;s because people find it informative. I happen to know the theory, but I wouldn&#x27;t gatekeep.