|
|
论文:2020,Vol:38,Issue(4):828-837 |
|
|
引用本文： |
|
|
吴琳琳, 彭国华, 延伟东. 基于判别性样本选择的无监督领域自适应方法[J]. 西北工业大学学报 |
|
|
WU Linlin, PENG Guohua, YAN Weidong. Unsupervised Domain Adaptation Method Based on Discriminant Sample Selection[J]. Northwestern polytechnical university |
|
|
|
|
|
|
|
| 基于判别性样本选择的无监督领域自适应方法 |
|
| 吴琳琳, 彭国华, 延伟东 |
|
| 西北工业大学 数学与统计学院, 陕西 西安 710072 |
| 摘要: |
| 针对现实中由于训练集与测试集分布不同而导致分类准确率较低的问题，提出基于判别性样本选择的无监督领域自适应方法（简称DSS算法）。为了减少源域和目标域的分布差异，将2个领域样本投影到同一子空间中，并对源域中的样本进行加权，使样本更具有判别性；不同于以往基于样本的概率密度估计方法，通过求解一个二次规划问题得到样本权重，避免了对样本分布进行估计，适用于任何领域且不会受到高维密度估计所造成的维数困扰；最后通过最小化类内距离来实现同类聚集。实验结果表明，该方法提高了数据集的分类准确率且具有较好的鲁棒性。 |
| 关键词:
样本选择
领域自适应
二次规划
类内距离
分类
|
|
| Unsupervised Domain Adaptation Method Based on Discriminant Sample Selection |
|
| WU Linlin, PENG Guohua, YAN Weidong |
|
| School of Mathematics and Statistics, Northwestern Polytechnical University, Xi'an 710072, China |
| Abstract: |
| In order to solve the problem that low classification accuracy caused by the different distribution of training set and test set, an unsupervised domain adaptation method based on discriminant sample selection (DSS) is proposed. DSS projects the samples of different domains onto a same subspace to reduce the distribution discrepancy between the source domain and the target domain, and weights the source domain instances to make the samples more discriminant. Different from the previous method based on the probability density estimation of samples, DSS tries to obtain the sample weights by solving a quadratic programming problem, which avoids the distribution estimation of samples and can be applied to any fields without suffering from the dimensional trouble caused by high-dimensional density estimation. Finally, DSS congregates the same classes by minimizing the intra-class distance. Experimental results show that the proposed method improves the classification accuracy and robustness. |
| Key words:
sample selection
domain adaptation
quadratic programming
intra-class distance
classification
|
|
| 收稿日期: 2019-10-23
修回日期:
|
| DOI: 10.1051/jnwpu/20203840828 |
| 基金项目: 陕西省自然科学基金（2017JM6026）资助 |
| 通讯作者:
Email： |
| 作者简介: 吴琳琳(1996-),女,西北工业大学硕士研究生,主要从事迁移学习、图像处理研究。
|
|
|
|
|
|
|
|
参考文献: |
|
|
[1] PAN S J, YANG Q. A Survey on Transfer Learning[J]. IEEE Trans on Knowledge and Data Engineering, 2010, 22(10):1345-1359
[2] SO Y J, NAMHYUN A, YUNSOO L, et al. Transfer Learning-Based Vehicle Classification[C]//2018 International SoC Design Conference, 2018
[3] SHI Q, ZHANG Y, LIU X, et al. Regularised Transfer Learning for Hyperspectral Image Classification[J]. IET Computer Vision, 2019, 13(2):188-193
[4] HUANG Z, CAO Y, WANG T. Transfer Learning with Efficient Convolutional Neural Networks for Fruit Recognition[C]//IEEE 3rd Information Technology, Networking, Electronic and Automation Control Conference, 2019
[5] ZHENG W, ZONG Y, ZHOU X, et al. Cross-Domain Color Facial Expression Recognition Using Transductive Transfer Subspace Learning[J]. IEEE Trans on Affective Computing, 2016, 9(1):21-37
[6] AMORNPAN P, PRAISAN P. Face Recognition Using Transferred Deep Learning for Feature Extraction[C]//2019 Joint International Conference on Digital Arts, Media and Technology with ECTI Northern Section Conference on Electrical, Electronics, Computer and Telecommunications Engineering, 2019
[7] CHEN L. Assertion Detection in Clinical Natural Language Processing:a Knowledge-Poor Machine Learning Approach[C]//2019 IEEE 2nd International Conference on Information and Computer Technologies, 2019
[8] IOAN C S. Integrating Deep Learning for NLP in Romanian Psychology[C]//2018 20th International Symposium on Symbolic and Numeric Algorithms for Scientific Computing, 2018
[9] VAN O A, IKRAM M A, VERNOOIJ M W, et al. Transfer Learning Improves Supervised Image Segmentation Across Imaging Protocols[J]. IEEE Trans on Medical Imaging, 2015, 34(5):1018-1030
[10] ANNEGREET V O, ACHTERBERG H C, VERNOOIJ M W, et al. Transfer Learning for Image Segmentation by Combining Image Weighting and Kernel Learning[J]. IEEE Trans on Medical Imaging, 2018, 38(1):213-224
[11] DAI W, YANG Q, XUE G R, et al. Boosting for Transfer Learning[C]//International Conference on Machine Learning, 2007
[12] HUANG J, SMOLA A J, GRETTON A, et al. Correcting Sample Selection Bias by Unlabeled Data[C]//International Conference on Neural Information Processing Systems, 2006
[13] TAN B, SONG Y, ZHONG E, et al. Transitive Transfer Learning[C]//The 21th ACM SIGKDD International Conference, 2015
[14] CHEN M, WEINBERGER K Q, BLITZER J C. Co-Training for Domain Adaptation[J]. Advances in Data Analysis & Classification, 2011, 8(4):1-23
[15] JIANG J, ZHAI C. Instance Weighting for Domain Adaptation in NLP[C]//The 45th Annual Meeting of the Association of Computational Linguistics, 2007
[16] JIANG J. A Literature Survey on Domain Adaptation of Statistical Classifiers[J]. British Journal of Psychiatry, 2008, 131(7):83-89
[17] LONG M, WANG J, DING G, et al. Transfer Joint Matching for Unsupervised Domain Adaptation[C]//2014 IEEE Conference on Computer Vision and Pattern Recognition, 2014
[18] PAN S J, TSANG I W, KWOK J T, et al. Domain Adaptation via Transfer Component Analysis[J]. IEEE Trans on Neural Networks, 2011, 22(2):199-210
[19] LONG M, WANG J, DING G, et al. Transfer Feature Learning with Joint Distribution Adaptation[C]//IEEE International Conference on Computer Vision, 2013
[20] WANG J, CHEN Y, FENG W, et al. Transfer Learning with Dynamic Distribution Adaptation[J]. ACM Trans on Intelligent Systems and Technology, 2019, 1(1):1-25
[21] GRAUMAN K. Geodesic Flow Kernel for Unsupervised Domain Adaptation[C]//2012 IEEE Conference on Computer Vision and Pattern Recognition, 2012
[22] JHUO I H, LIU D, LEE D T, et al. Robust Visual Domain Adaptation with Low-Rank Reconstruction[C]//Computer Vision and Pattern Recognition, 2013
[23] WANG J, CHEN Y, HU L, et al. Stratified Transfer Learning for Cross-Domain Activity Recognition[C]//IEEE International Conference on Pervasive Computing and Communications, 2018
[24] GRETTON A, BORGWARDT K M, RASCH M, et al. A Kernel Method for the Two Sample Problem[C]//Neural Information Processing Systems, 2008
[25] SMOLA A, GRETTON A, SONG L, et al. a Hilbert Space Embedding for Distributions[C]//International Conference on Algorithmic Learning Theory, 2007
[26] ZHONG E, ZHANG K, REN J, et al. Cross Domain Distribution Adaptation via Kernel Mapping[C]//ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, 2009
[27] QUANZ B, HUAN J, MISHRA M. Knowledge Transfer with Low-Quality Data:A Feature Extraction Issue[J]. IEEE Trans on Knowledge and Data Engineering, 2012, 24(10):1789-1802
[28] GEORGE C, ROGER L B. Statistical Inference[M]. 2nd edition. Beijing:China Machine Press, 2002
[29] 刘建伟, 孙正康, 罗雄麟. 域自适应学习研究进展[J]. 自动化学报, 2014, 40(8):1576-1600 LIU Jianwei, SUN Zhengkang, LUO Xionglin. Review and Research Development on Domain Adaptation Learning[J]. Acta Automatica Sinica, 2014, 40(8):1576-1600(in Chinese)
[30] SHUANG L, SHIJI S, GAO H, et al. Domain Invariant and Class Discriminative Feature Learning for Visual Domain Adaptation[J]. IEEE Trans on Image Processing, 2018, 27(9):4260-4273
[31] PENG J, SUN W, MA L, et al. Discriminative Transfer Joint Matching for Domain Adaptation in Hyperspectral Image Classification[J]. IEEE Geoscience and Remote Sensing Letters, 2019, 16(6):972-976 |
|
|
|
|
|
|
|
