David L. Donoho

ORCID: 0000-0003-1830-710X
Publications
Citations
Views
---
Saved
---
About
Contact & Profiles
Research Areas
  • Image and Signal Denoising Methods
  • Sparse and Compressive Sensing Techniques
  • Blind Source Separation Techniques
  • Statistical Methods and Inference
  • Medical Image Segmentation Techniques
  • Mathematical Analysis and Transform Methods
  • Seismic Imaging and Inversion Techniques
  • Advanced Image Fusion Techniques
  • Advanced MRI Techniques and Applications
  • Random Matrices and Applications
  • Advanced Numerical Analysis Techniques
  • Bayesian Methods and Mixture Models
  • Cell Image Analysis Techniques
  • Statistical and numerical algorithms
  • Advanced Image Processing Techniques
  • Microwave Imaging and Scattering Analysis
  • Distributed Sensor Networks and Detection Algorithms
  • Advanced Data Compression Techniques
  • Statistical Methods and Bayesian Inference
  • Advanced Statistical Methods and Models
  • Image Retrieval and Classification Techniques
  • Medical Imaging Techniques and Applications
  • NMR spectroscopy and applications
  • Scientific Computing and Data Management
  • Topological and Geometric Data Analysis

Stanford University
2016-2025

Harvard University Press
1981-2013

Sequoia (United States)
2002-2009

Stanford Medicine
2003-2009

University of California, San Diego
2006-2009

Purdue University West Lafayette
2006

Georgia Institute of Technology
2006

Tel Aviv University
2006

AT&T (United States)
2003

University of California, Berkeley
1988-2002

Suppose x is an unknown vector in Ropf <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">m</sup> (a digital image or signal); we plan to measure n general linear functionals of and then reconstruct. If known be compressible by transform coding with a transform, reconstruct via the nonlinear procedure defined here, number measurements can dramatically smaller than size m. Thus, certain natural classes images m pixels need only n=O(m...

10.1109/tit.2006.871582 article EN IEEE Transactions on Information Theory 2006-04-01

Donoho and Johnstone (1994) proposed a method for reconstructing an unknown function f on [0,1] from noisy data d/sub i/=f(t/sub i/)+/spl sigma/z/sub i/, i=0, ..., n-1,t/sub i/=i/n, where the z/sub i/ are independent identically distributed standard Gaussian random variables. The reconstruction f/spl circ/*/sub n/ is defined in wavelet domain by translating all empirical coefficients of d toward 0 amount /spl sigma//spl middot//spl radic/(2log (n)/n). authors prove two results about this...

10.1109/18.382009 article EN IEEE Transactions on Information Theory 1995-05-01

SUMMARY With ideal spatial adaptation, an oracle furnishes information about how best to adapt a spatially variable estimator, whether piecewise constant, polynomial, knot spline, or bandwidth kernel, the unknown function. Estimation with aid of offers dramatic advantages over traditional linear estimation by nonadaptive kernels; however, it is priori unclear such performance can be obtained procedure relying on data alone. We describe new principle for spatially-adaptive estimation:...

10.1093/biomet/81.3.425 article EN Biometrika 1994-09-01

The time-frequency and time-scale communities have recently developed a large number of overcomplete waveform dictionaries --- stationary wavelets, wavelet packets, cosine chirplets, warplets, to name few. Decomposition into systems is not unique, several methods for decomposition been proposed, including the method frames (MOF), Matching pursuit (MP), and, special dictionaries, best orthogonal basis (BOB). Basis Pursuit (BP) principle decomposing signal an "optimal" superposition dictionary...

10.1137/s1064827596304010 article EN SIAM Journal on Scientific Computing 1998-01-01

Abstract The sparsity which is implicit in MR images exploited to significantly undersample k ‐space. Some such as angiograms are already sparse the pixel representation; other, more complicated have a representation some transform domain–for example, terms of spatial finite‐differences or their wavelet coefficients. According recently developed mathematical theory compressed‐sensing, with can be recovered from randomly undersampled ‐space data, provided an appropriate nonlinear recovery...

10.1002/mrm.21391 article EN Magnetic Resonance in Medicine 2007-10-29

The time-frequency and time-scale communities have recently developed a large number of overcomplete waveform dictionaries---stationary wavelets, wavelet packets, cosine chirplets, warplets, to name few. Decomposition into systems is not unique, several methods for decomposition been proposed, including the method frames (MOF), matching pursuit (MP), and, special dictionaries, best orthogonal basis (BOB). Basis (BP) principle decomposing signal an "optimal"' superposition dictionary...

10.1137/s003614450037906x article EN SIAM Review 2001-01-01

Abstract We attempt to recover a function of unknown smoothness from noisy sampled data. introduce procedure, SureShrink, that suppresses noise by thresholding the empirical wavelet coefficients. The is adaptive: A threshold level assigned each dyadic resolution principle minimizing Stein unbiased estimate risk (Sure) for estimates. computational effort overall procedure order N · log(N) as sample size N. SureShrink If contains jumps, then reconstruction (essentially) does also; if has...

10.1080/01621459.1995.10476626 article EN Journal of the American Statistical Association 1995-12-01

Given a dictionary D = { d k } of vectors , we seek to represent signal S as linear combination ∑ γ( ) with scalar coefficients γ ( ). In particular, aim for the sparsest representation possible. general, this requires combinatorial optimization process. Previous work considered special case where is an overcomplete system consisting exactly two orthobases and has shown that, under condition mutual incoherence bases, assuming that sufficiently sparse representation, unique can be found by...

10.1073/pnas.0437847100 article EN Proceedings of the National Academy of Sciences 2003-02-21

Abstract We consider linear equations y = Φ x where is a given vector in ℝ n and × m matrix with &lt; ≤ τ , we wish to solve for ∈ . suppose that the columns of are normalized unit 𝓁 2 ‐norm, place uniform measure on such Φ. prove existence ρ ρ(τ) &gt; 0 so large all Φ's except negligible fraction, following property holds: For every having representation by coefficient fewer than · nonzeros, solution 1 ‐minimization problem unique equal In contrast, heuristic attempts sparsely...

10.1002/cpa.20132 article EN Communications on Pure and Applied Mathematics 2006-03-23

This paper describes two digital implementations of a new mathematical transform, namely, the second generation curvelet transform in and three dimensions. The first transformation is based on unequally spaced fast Fourier transforms, while wrapping specially selected samples. essentially differ by choice spatial grid used to translate curvelets at each scale angle. Both transformations return table coefficients indexed parameter, an orientation location parameter. And both are sense that...

10.1137/05064182x article EN Multiscale Modeling and Simulation 2006-01-01

Journal Article Ideal spatial adaptation by wavelet shrinkage Get access David L Donoho, Donoho Department of Statistics, Stanford University, Stanford, California, U.S.A Search for other works this author on: Oxford Academic Google Scholar Iain M Johnstone Biometrika, Volume 81, Issue 3, September 1994, Pages 425–455, https://doi.org/10.1093/biomet/81.3.425 Published: 01 1994 history Received: August 1992 Revision received: June 1993

10.2307/2337118 article EN Biometrika 1994-08-01

Compressed sensing aims to undersample certain high-dimensional signals, yet accurately reconstruct them by exploiting signal characteristics. Accurate reconstruction is possible when the object be recovered sufficiently sparse in a known basis. Currently, best sparsity-undersampling tradeoff achieved reconstructing convex optimization -- which expensive important large-scale applications. Fast iterative thresholding algorithms have been intensively studied as alternatives for problems....

10.1073/pnas.0909892106 article EN Proceedings of the National Academy of Sciences 2009-10-27

Overcomplete representations are attracting interest in signal processing theory, particularly due to their potential generate sparse of signals. However, general, the problem finding must be unstable presence noise. This paper establishes possibility stable recovery under a combination sufficient sparsity and favorable structure overcomplete system. Considering an ideal underlying that has sufficiently representation, it is assumed only noisy version can observed. Assuming further system...

10.1109/tit.2005.860430 article EN IEEE Transactions on Information Theory 2005-12-28

A full-rank matrix ${\bf A}\in \mathbb{R}^{n\times m}$ with $n<m$ generates an underdetermined system of linear equations Ax} = {\bf b}$ having infinitely many solutions. Suppose we seek the sparsest solution, i.e., one fewest nonzero entries. Can it ever be unique? If so, when? As optimization sparsity is combinatorial in nature, are there efficient methods for finding solution? These questions have been answered positively and constructively recent years, exposing a wide variety surprising...

10.1137/060657704 article EN SIAM Review 2009-02-05

This article reviews the requirements for successful compressed sensing (CS), describes their natural fit to MRI, and gives examples of four interesting applications CS in MRI. The authors emphasize on an intuitive understanding by describing reconstruction as a process interference cancellation. There is also emphasis driving factors applications, including limitations imposed MRI hardware, characteristics different types images, clinical concerns.

10.1109/msp.2007.914728 article EN IEEE Signal Processing Magazine 2008-03-01

Suppose a discrete-time signal S(t), 0/spl les/t<N, is superposition of atoms taken from combined time-frequency dictionary made spike sequences 1/sub {t=/spl tau/}/ and sinusoids exp{2/spl pi/iwt/N}//spl radic/N. Can one recover, knowledge S alone, the precise collection going to make up S? Because every can be represented as spikes or there no unique way writing sum in general. We prove that if representable highly sparse this dictionary, then only such representation S, it obtained by...

10.1109/18.959265 article EN IEEE Transactions on Information Theory 2001-01-01

We describe a method for recovering the underlying parametrization of scattered data ( m i ) lying on manifold M embedded in high-dimensional Euclidean space. The method, Hessian-based locally linear embedding, derives from conceptual framework local isometry which , viewed as Riemannian submanifold ambient space ℝ n is isometric to an open, connected subset Θ d . Because does not have be convex, this able handle significantly wider class situations than original ISOMAP algorithm....

10.1073/pnas.1031596100 article EN Proceedings of the National Academy of Sciences 2003-04-30

Abstract We attempt to recover a function of unknown smoothness from noisy sampled data. introduce procedure, SureShrink, that suppresses noise by thresholding the empirical wavelet coefficients. The is adaptive: A threshold level assigned each dyadic resolution principle minimizing Stein unbiased estimate risk (Sure) for estimates. computational effort overall procedure order N · log(N) as sample size N. SureShrink If contains jumps, then reconstruction (essentially) does also; if has...

10.2307/2291512 article EN Journal of the American Statistical Association 1995-12-01

SUMMARY Much recent effort has sought asymptotically minimax methods for recovering infinite dimensional objects—curves, densities, spectral images—from noisy data. A now rich and complex body of work develops nearly or exactly estimators an array interesting problems. Unfortunately, the results have rarely moved into practice, a variety reasons—among them being similarity to known methods, computational intractability lack spatial adaptivity. We discuss method curve estimation based on n...

10.1111/j.2517-6161.1995.tb02032.x article EN Journal of the Royal Statistical Society Series B (Statistical Methodology) 1995-07-01

Abstract This paper introduces new tight frames of curvelets to address the problem finding optimally sparse representations objects with discontinuities along piecewise C 2 edges. Conceptually, curvelet transform is a multiscale pyramid many directions and positions at each length scale, needle‐shaped elements fine scales. These have useful geometric features that set them apart from classical such as wavelets. For instance, obey parabolic scaling relation which says scale − j , element has...

10.1002/cpa.10116 article EN Communications on Pure and Applied Mathematics 2003-11-14

Finding the sparsest solution to underdetermined systems of linear equations <i xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">y</i> = Φ <sub xmlns:xlink="http://www.w3.org/1999/xlink">x</sub> is NP-hard in general. We show here that for with "typical"/"random" Φ, a good approximation obtained by applying fixed number standard operations from algebra. Our proposal, Stagewise Orthogonal Matching Pursuit (StOMP), successively transforms signal into...

10.1109/tit.2011.2173241 article EN IEEE Transactions on Information Theory 2012-02-01

The uncertainty principle can easily be generalized to cases where the “sets of concentration” are not intervals. Such generalizations presented for continuous and discrete-time functions, several measures “concentration” (e.g., $L_2 $ $L_1 measures). explain interesting phenomena in signal recovery problems there is an interplay missing data, sparsity, bandlimiting.

10.1137/0149053 article EN SIAM Journal on Applied Mathematics 1989-06-01
Coming Soon ...