siwei lyu image

Siwei Lyu, Ph.D. [CV] [Google Scholar] [DBLP]

Associate Professor, Department of Computer Science
Director, Computer Vision and Machine Learning Lab
College of Engineering and Applied Sciences
University at Albany, State University of New York
Phone: (518) 437-4938
Email: slyu AT albany DOT edu
Office: UAB414, 1215 Western Avenue, Albany, NY12222

Publications by Years:

[2018 | 2017 | 2016 | 2015 | 2014 | 2013 | 2012 | 2011 | 2010 | 2009 | 2008 | 2007 | 2006 | 2005 | 2004 | 2003 | 2002]


2018 [top]

  1. Dawei Du, Longyin Wen, Honggang Qi, Qingming Huang, Tian Qi, and Siwei Lyu. Constrained Graph Seeking for Object Tracking. IEEE Transactions on Image Processing, (to appear) 2018.
  2. Hui Zeng, Jingjing Yu, Xiangui Kang, and Siwei Lyu. "Countering JPEG anti-forensics based on noise level estimation". Science China Information Sciences, 61:032103, 2018


2017 [top]

  1. Siwei Lyu and et.al. "AVSS 2017 Challenge On Advanced Traffic Monitoring." In International Conference on Advanced Video and Signal-Based Surveillance (AVSS), Lecce, Italy, 2017.

  2. Ming-Ching Chang, Yi Wei, Nenghui Song, Lipeng Ke, and Siwei Lyu. "Traffic analysis based on object detection and vehicle tracking". In 2017 IEEE AI City Challenge, San Jose, CA, 2017. IEEE.

  3. Milind Naphade, David C. Anastasiu, Anuj Sharma, Vamsi Jagrlamudi, Hyeron Jeon, Kaikai Liu, Ming-Ching Chang, Siwei Lyu, and Zeyu Gao. "The NVIDIA AI City Challenge". In IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computed, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation, SmartWorld’17, Piscataway, NJ, USA, 2017.

  4. (as participating team). "The Visual Object Tracking VOT2017 Challenge Results". In ICCV Workshop on Visual Object Tracking Challenge, Venice, Italy, 2017.

  5. Yanbo Fan, Siwei Lyu, Yiming Ying and Baogang Hu. "Average Top-k Learning". In Advances in Neural Information Processing Systems (NIPS), Long Beach, CA, 2017. (Acceptance rate 21% of 3240 submissions).

  6. Wenbo Li, Longyin Wen, Ming-Ching Chang, Ser Nam Lim, and Siwei Lyu. "Adaptive RNN tree for large-scale human action recognition". In IEEE International Conference on Computer Vision (ICCV), Venice, Italy, 2017.

  7. Dawei Du, Honggang Qi, Longyin Wen, Qingming Huang, Tian Qi, and Siwei Lyu. "Geometric hypergraph learning for visual tracking". IEEE Transactions on Cybernetics, 47(12):4182–4195, 2017.

  8. Shengkun Li, Dawei Du, Longyin Wen, Ming-Ching Chang, and Siwei Lyu. "Hybrid structure hypergraph for online deformable object tracking". In IEEE Conference on Image Processing (ICIP), Beijing, China, 2017.

  9. Andrew Pulver and Siwei Lyu, “LSTM with Working Memory,” in International Joint Conference on Neural Networks (IJCNN), Anchorage, AK, 2017.

  10. Yang Yang, Longyin Wen, Siwei Lyu, and Stan Z. Li, “Learning Multi-Level Descriptors for Person Re-Identification,” in 31st AAAI Conference on Artificial Intelligence (AAAI-17), San Francisco, CA, 2017.

  11. Dawei Du, Honggang Qi, Longyin Wen, Qingming Huang, Tian Qi, and Siwei Lyu, “Geometric Hypergraph Learning for Visual Tracking,” IEEE Transactions on Cybernetics, 47(12):4182–4195, 2017.


2016 [top]

  1. Longyin Wen, Zhen Lei, Ming-Ching Chang, Honggang Qi, and Siwei Lyu, “Multi-Camera Multi-Target Tracking with Space-Time-View Hyper-graph,” International Journal of Computer Vision, 122(2):313–333, 2016.

  2. Honggang Qi, Andrew Pulver, and Siwei Lyu, “Using 3D Face Model for Forensic Analysis of Lighting Environment,” in IEEE Workshop on Information Forensics and Security (WIFS), Abu Dabhi, UAE, 2016.

  3. Yueming Yang, “Efficient Large-Scale Photometric Reconstruction,” PhD thesis, Computer Science Department, SUNY Albany, Albany, NY, 2016.

  4. Yiming Ying, Longyin Wen, and Siwei Lyu, “Stochastic Online AUC Maximization,” in Advances in Neural Information Processing Systems (NIPS), Barcelona, Spain, 2016. (oral presentation)

  5. Shuai Li, Siwei Lyu, and Jeff Trinkle, “Contact Aware Robotics Manipulation,” in Work Shop on Tactile Sensing for Manipulation: New progress and Challenges (in conjucntion with IEEE RAS-Humanoids), Cancun, Mexico, 2016.

  6. Yueming Yang, Ming-Ching Chang, Longyin Wen, Peter Tu, Honggang Qi, and Siwei Lyu, “Efficient Large-scale Photometric Reconstruction Using Divide-Recon-Fuse 3D Structure from Motion,” in International Conference on Advanced Video and Signal-Based Surveillance (AVSS), Colorado Springs, CO, 2016.

  7. Dawei Du, Honggang Qi, Wenbo Li, Longyin Wen, Qingming Huang, and Siwei Lyu, “Online Deformable Object Tracking Based on Structure-Aware Hyper-graph,” IEEE Transactions on Image Processing, 25(8):3572 – 3584, 2016.

  8. Martin Boissier, Yiming Ying, Siwei Lyu, and Dingxuan Zhou, “Fast Convergence of Online Pairwise Learning Algorithms,” in The 19th International Conference on Artificial Intelligence and Statistics (AISTATS), Cadiz, Spain, 2016.

  9. Yan Kong, Weiming Dong, Xing Mei, Chongyang Ma, Tong-Yee Lee, Siwei Lyu, Feiyue Huang, and Xiaopeng Zhang, “Measuring and Predicting Visual Importance of Similar Objects,” IEEE Transactions on Visualization and Computer Graphics, 22(12):2564 – 2578, 2016.

  10. Longyin Wen, Zhen Lei, Siwei Lyu, Stan Z. Li, and Ming-Hsuan Yang, “Exploiting Hierarchical Dense Structures on Hypergraphs for Multi-Object Tracking,” IEEE Transactions on Pattern Analysis and Machine Intelligence, 38(10):1983–1996, 2016.

  11. Baoyuan Wu, Siwei Lyu, and Bernard S. Ghanem, “Multi-label Learning to Missing Labels and Class Imbalance,” in 30th AAAI Conference on Artificial Intelligence (AAAI-16), Pheonix, AZ, 2016.

  12. Xin Wang, Yiming Ying, Ming-Ching Chang, and Siwei Lyu, “Co-regularized PLSA For Multi-Modal Learning,” in 30th AAAI Conference on Artificial Intelligence (AAAI-16), Pheonix, AZ, 2016.


2015 [top]

  1. (as participating team), “The Visual Object Tracking VOTITR2015 challenge results,” in ICCV Workshop on Visual Object Tracking Challenge, Santiago, Chile, 2015.

  2. (as participating team), “The Visual Object Tracking VOT2015 challenge results,” in ICCV Workshop on Visual Object Tracking Challenge, Santiago, Chile, 2015.

  3. Wenbo Li, Longyin Wen, Mooi Choo Chua, and Siwei Lyu, “Category-blind Human Action Recognition: A Practical Recognition System,” in IEEE International Conference on Computer Vision (ICCV), Santiago, Chile, 2015.

  4. Baoyuan Wu, Siwei Lyu, and Bernard S. Ghanem, “ML-MG: Multi-label Learning with Missing Labels Using a Mixed Graph,” in IEEE International Conference on Computer Vision (ICCV), Santiago, Chile, 2015.

  5. Xing Mei, Honggang Qi, Baogang Hu, and Siwei Lyu, “Improving Image Restoration with Soft-Rounding,” in IEEE International Conference on Computer Vision (ICCV), Santiago, Chile, 2015.

  6. Martin Boissier, Yiming Ying, Siwei Lyu, and Dingxuan Zhou, “Fast Convergence of Online Pairwise Learning Algorithms,” in NIPS Workshop on Optimization for Machine Learning, Montreal, QC, Canada, 2015.

  7. Ming-Ching Chang, Honggang Qi, Xin Wang, Hong Cheng, and Siwei Lyu, “Fast Online Upper Body Pose Estimation from Video,” in British Machine Vision Conference (BMVC), Swansea, England, 2015.

  8. Shuai Li, Siwei Lyu, Jeff Trinkle, and Wolfart Burgard, “An Evaluation of Particle Filters for Contact-SLAM Problems,” in IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Hamburg, Germany, 2015.

  9. Amanda Danko and Siwei Lyu, “Better Together: Fusing Visual Saliency Methods for Retrieving Perceptually Similar Images,” in IEEE Conference on Consumer Electronics (ICCE), Las Vegas, NV, 2015.

  10. Andrew Pulver, Ming-Ching Chang, and Siwei Lyu, “Shot Segmentation and Grouping for PTZ Camera Videos,” in Annual Symposium on Information Assurance (ASIA), Albany, NY, 2015.

  11. Xing Mei, Weiming Dong, Baogang Hu, and Siwei Lyu, “UniHIST: A Unified Framework for Image Restoration With Histogram,” in IEEE Conference on Computer Vision and Patten Recognition (CVPR), Boston, MA, 2015.

  12. Shuai Li, Siwei Lyu, and Jeff Trinkle, “State Estimation for Dynamic Systems with Intermittent Contact,” in IEEE Conference on Robotics and Automation (ICRA), Seattle, WA, 2015.

  13. Baoyuan Wu, Siwei Lyu, Baogang Hu, and Qiang Ji, “Multi-label Learning with Missing Labels for Image Annotation and Facial Action Unit Recognition,” Pattern Recognition, vol. 48, no. 7, pp. 2279–2289, 2015.

  14. Yelin Kim, Jixu Chen, Ming-Ching Chang, Xin Wang, Emily M. Provost, and Siwei Lyu, “Joint Event Localization and Classification of Human Action Videos with Event Transitions,” in IEEE International Conference on Automatic Face and Gesture Recognition (FG), Ljubljana, Slovenia, 2015.

  15. Amanda Danko and Siwei Lyu, “Fused Methods for Visual Saliency Estimation,” in SPIE Symposium on Electronic Imaging, San Jose, CA, 2015.

  16. Yueming Yang, Ming-Ching Chang, Peter Tu and Siwei Lyu, “Seeing As It Happens: Real Time 3D Video Event Visualization,” in IEEE Conference on Image Processing (ICIP), Québec City, Canada, 2015.


2014 [top]

  1. Shuai Li, Siwei Lyu, Jeff Trinkle, and Wolfart Burgard, “An Evaluation of Particle Filters for Contact-SLAM Problems,” in RSS Workshop on Information-based Grasp and Manipulation Planning, Berkeley, CA, 2014.

  2. Xing Mei, Baogang Hu, and Siwei Lyu, “Non-blind Image Restoration with Symmetric Generalized Pareto Priors,” in IEEE Conference on Image Processing (ICIP), Paris, France, 2014.

  3. Xing Zhang and Siwei Lyu, “Estimating Covariance Matrix Of Correlated Image Noise,” in IEEE Conference on Image Processing (ICIP), Paris, France, 2014.

  4. Xing Zhang and Siwei Lyu, “Variational EM Learning of Deep Stack Boltzmann Networks with Deep Boltzmann Machines,” in International Conference on Artificial Neural Networks (ICANN), Hamburg, Germany, 2014.

  5. Xing Zhang and Siwei Lyu, “Blind Estimation Of Pixel Brightness Transform,” in IEEE Conference on Image Processing (ICIP), Paris, France, 2014.

  6. Xing Zhang and Siwei Lyu, “Using Projection Kurtosis Concentration Of Natural Images For Blind Noise Covariance Matrix Estimation,” in IEEE Conference on Computer Vision and Patten Recognition (CVPR), Columbus, OH, 2014.

  7. Eric Lifshin, Siwei Lyu, Yudal P. Kandel, and Richard L. Moore, “The Use of Regularized Least Squares Minimization for the Deconvolution of SEM Images,” in Microscopy & Microanalysis, Hartford, CT, 2014.

  8. Eric Lifshin, Yudal P. Kandel, Richard L. Moore, and Siwei Lyu, “Improved SEM Image Resolution Through the Use of Image Restoration Techniques,” in Microscopy & Microanalysis, Hartford, CT, 2014.

  9. Siwei Lyu, Xunyu Pan, and Xing Zhang, “Exposing Region Splicing Forgeries with Blind Local Noise Estimation,” International Journal of Computer Vision, vol. 110, no. 2, pp. 202–221, Nov. 2014.

  10. Weiyi Sun, Jianwei Zhang, Hui Jin, and Siwei Lyu, “Probabilistic Topic Analysis of Online Knowledge Building Discourse,” in NIPS Workshop on Data Driven Education, Lake Tahoe, NV, 2014.

  11. Weiyi Sun, Jianwei Zhang, Hui Jin, and Siwei Lyu, “Analyzing Online Knowledge Building Discourse Using Probabilistic Topic Models,” in International Conference of the Learning Sciences (ICLS), Boulder, CO, 2014.


2013 [top]

  1. Baoyuan Wu, Siwei Lyu, Baogang Hu, and Qiang Ji, “Simultaneous Clustering and Tracklet Linking for Multi-Face Tracking in Videos,” in IEEE International Conference on Computer Vision (ICCV), Sydney, Austrilia, 2013.

  2. Li Zhang, Siwei Lyu, and Jeff Trinkle, “A Dynamic Bayesian Approach to Simultaneous Estimation and Filtering in Grasp Acquisition,” in IEEE Conference on Robotics and Automation (ICRA), Karsrugher, Germany, 2013.

  3. Siwei Lyu, “Bayesian Supervised Learning With Non-Gaussian Latent Variables,” in IEEE International Conference and China Forum on Signal and Information Processing (ChinaSIP), Beijing, China, 2013.

  4. Zuoguan Wang, Siwei Lyu, and Qiang Ji, “Deep Feature Learning using Target Priors with Applications in ECoG Signal Decoding for BCI,” in International Joint Conference on Artificial Intelligence (IJCAI), Beijing, China, 2013.

  5. Siwei Lyu and Xin Wang, “On Algorithms of Sparse Multi-factor Nonnegative Matrix Factorization,” in Advances in Neural Information Processing Systems (NIPS), Lake Tahoe, NV, 2013.

  6. Siwei Lyu, “An Upper-Bound On Second-Order Dependency,” in IEEE International Conference and China Forum on Signal and Information Processing (ChinaSIP), Beijing, China, 2013.


2012 [top]

  1. Jixu Chen, Xiaoming Liu, and Siwei Lyu, “Boosting with Side Information,” in Asian Conference on Computer Vision (ACCV), Daejeon, Korea, 2012.

  2. Zuoguan Wang, Siwei Lyu, G. Schalk, K. Miller, and Qiang Ji, “Learning with Target Priors,” in Advances in Neural Information Processing Systems (NIPS), Lake Tahoe, NV, 2012.

  3. Siwei Lyu, “Natural Image Statistics for Digital Image Forensics,” in Digital Image Forensics: There is More to a Picture than Meets the Eye, H. T. Sencar and N. Memon, Eds. Springer, 2012.

  4. Xunyu Pan, “Digital Forensics Using Local Signal Statistics,” PhD thesis, Computer Science Department, SUNY Albany, Albany, NY, 2012.

  5. Xunyu Pan, Xing Zhang, and Siwei Lyu, “Blind Local Noise Estimation for Medical Images Reconstructed from Rapid Acquisition,” in SPIE Symposium on Medical Imaging, San Diego, CA, 2012.

  6. Xunyu Pan, Xing Zhang, and Siwei Lyu, “Exposing Image Splicing with Inconsistent Local Noise Variances,” in IEEE International Conference on Computational Photography, Seattle, WA, 2012.

  7. Xunyu Pan, Xing Zhang, and Siwei Lyu, “Detecting Splicing In Digital Audios Using Local Noise Level Estimation,” in IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Kyoto, Japan, 2012.


2011 [top]

  1. Siwei Lyu, “Divisive Normalization as an Efficient Coding Transform: Justification and Effectiveness,” Neural Computation, vol. 23, no. 11, pp. 2942–2973, Nov. 2011.

  2. Siwei Lyu, “Unifying Non-Maximum Likelihood Learning Objectives with Minimum KL Contraction,” in Advances in Neural Information Processing Systems (NIPS), Granada, Spain, 2011.

  3. Xunyu Pan, Xing Zhang, and Siwei Lyu, “Exposing Image Forgery with Blind Noise Estimation,” in ACM Workshop on Multimedia and Security (MM&Sec), Niagara Falls, NY, 2011.


2010 [top]

  1. Siwei Lyu, “Divisive Normalization: Justification and Effectiveness as Efficient Coding Transform,” in Advances in Neural Information Processing Systems (NIPS), Vancouver, Canada, 2010.

  2. Xunyu Pan and Siwei Lyu, “Region Duplication Detection Using Image Feature Matching,” IEEE Transactions on Information Forensics and Security, vol. 5, no. 4, pp. 857–867, Dec. 2010.

  3. Siwei Lyu, “Nonnegative Matrix Factorization with Matrix Exponentiation,” in IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Dallas, USA, 2010.

  4. Siwei Lyu, “Single Image Vignetting Correction with Natural Image Statistics in Derivative Domains,” in IEEE Conference on Image Processing (ICIP), Hongkong, 2010.

  5. Xunyu Pan and Siwei Lyu, “Detecting Image Region Duplication using SIFT Features,” in IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Dallas, USA, 2010.

  6. Siwei Lyu, “Estimating Vignetting Function from a Single Image for Image Authentication,” in ACM Workshop on Multimedia and Security (MM&Sec), Rome, Italy, 2010.


2009 [top]

  1. Siwei Lyu and Eero P. Simoncelli, “Nonlinear extraction of ’Independent Components’ of natural images using radial Gaussianization,” Neural Computation, vol. 18, no. 6, pp. 1–35, Jun. 2009.

  2. Siwei Lyu and Eero P. Simoncelli, “Modeling multiscale subbands of photographic images with fields of Gaussian scale mixtures,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 31, no. 4, pp. 693–706, Apr. 2009.

  3. Siwei Lyu, “Interpretation and Generalization of Score Matching,” in The International Conference on Uncertainty in Artificial Intelligence (UAI), Montreal, QC, Canada, 2009.

  4. Siwei Lyu, “An Implicit Markov Random Field Model for Natural Images in Multi-scale Oriented Representations,” in IEEE Conference on Computer Vision and Patten Recognition (CVPR), Miami Beach, FL, 2009.


2008 [top]

  1. Siwei Lyu, “Natural Image Statistics in Digital Image Forensics.” VDM Verlag, 2008.

  2. Siwei Lyu and Eero P. Simoncelli, “Nonlinear image representation using divisive normalization,” in IEEE Conference on Computer Vision and Patten Recognition (CVPR), Anchorage, AK, 2008.

  3. Siwei Lyu and Eero P. Simoncelli, “Reducing statistical dependencies in natural signals using radial Gaussianization,” in Advances in Neural Information Processing Systems (NIPS), Vancouver, Canada, 2008. (oral presentation)


2007 [top]

  1. Siwei Lyu and Eero P. Simoncelli, “Statistically and Perceptually Motivated Nonlinear Image Representation,” in IS&T/SPIE 19th Annual Symposium of Electronic Imaging, San Jose, CA, 2007.


2006 [top]

  1. Siwei Lyu and Eero P. Simoncelli, “Statistical Modeling of Images with Fields of Gaussian Scale Mixtures,” in Advances in Neural Information Processing Systems (NIPS), Vancouver, Canada, 2006.

  2. Siwei Lyu and Hany Farid, “Steganalysis Using Higher-Order Image Statistics,” IEEE Transactions on Information Forensics and Security, vol. 1, no. 1, pp. 111–119, Jan. 2006.

  3. Dan Rockmore, Siwei Lyu, and Hany Farid, “A Digital Technique for Authentication in the Arts,” International Foundation for Art Research (IFAR) Journal, vol. 8, no. 2, pp. 21–29, 2006.


2005 [top]

  1. Siwei Lyu, “Natural Image Statistics for Digital Image Forensics,” PhD thesis, Department of Computer Science, Dartmouth College, Hanover, NH, 2005.

  2. Siwei Lyu, “Automatic Image Orientation Determination with Natural Image Statistics,” in ACM Multimedia, Singapore, 2005.

  3. Siwei Lyu, “Kernels for Unordered Sets: the Gaussian Mixture Approach,” in European Conference on Machine Learning (ECML), Porto, Portugal, 2005.

  4. Siwei Lyu, “Infomax Boosting,” in IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), San Diego, CA, 2005.

  5. Micah Kimo Johnson, Siwei Lyu, and Hany Farid, “Steganalysis of Recorded Speech,” in SPIE Symposium on Electronic Imaging, San Jose, CA, 2005.

  6. Siwei Lyu and Hany Farid, “How Realistic is Photorealistic?,” IEEE Transactions on Signal Processing, vol. 53, no. 2, pp. 845–850, Feb. 2005.

  7. Siwei Lyu, “Mercer Kernels for Object Recognition with Local Features,” in IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), San Diego, CA, 2005.

  8. Siwei Lyu, Dan Rockmore, and Hany Farid, “Wavelet Analysis for Art Authentication,” in Art+Math=X, Boulder, CO, 2005.


2004 [top]

  1. Siwei Lyu, Dan Rockmore, and Hany Farid, “A Digital Technique for Art Authentication,” Proceedings of the National Academy of Sciences, vol. 101, no. 49, pp. 17006–17010, Nov. 2004.

  2. Siwei Lyu and Hany Farid, “Steganalysis Using Color Wavelet Statistics and One-Class Support Vector Machines,” in SPIE Symposium on Electronic Imaging, San Jose, CA, 2004.


2003 [top]

  1. Hany Farid and Siwei Lyu, “Higher-Order Wavelet Statistics and their Application to Digital Forensics,” in CVPR Workshop on Statistical Analysis in Computer Vision, Madison, Wisconsin, 2003.


2002 [top]

  1. Siwei Lyu and Hany Farid, “Detecting Hidden Messages Using Higher-Order Statistics and Support Vector Machines,” in 5th International Workshop on Information Hiding, Noordwijkerhout, The Netherlands, 2002.