Portrait

Brian Kenji Iwana

Associate Professor at Kyushu University

Ph.D. Information Science, Kyushu University
B.S. Computer Engineering, University of California Irvine

Links

Research Interests

  • Document recognition
  • Character recognition
  • Design using machine learning
  • Time series classification
  • Neural networks
  • Dynamic programming

Research

Dynamic Weights for Neural Networks

Dynamic weight alignment for convolutional neural networks

This work optimizes the convolution in a Convolutional Neural Network (CNN) using dynamic programming to align the weights to the inputs. I showed that using dynamically aligned weights, it is possible to improve the accuracy of temporal CNNs.

Dynamic Time Warping Neural Network (DTW-NN)

A Dynamic Time Warping Neural Network (DTW-NN) is a feedforward neural network for time series recognition. A DTW-NN is designed to overcome temporal distortions by replacing the standard linear inner product of a multi-layer perceptron with a nonlinear kernel-like function, namely DTW.

Pattern Representation and Feature Extraction

Time series feature extraction

Dynamic Time Warping (DTW) is normally used as a robust distance measure for distance-based time series recognition methods. However, in this work, we use the local distances between elements in a DTW operation as features for multi-modal Convolutional Neural Networks (CNN).

Prototype selection for dissimilarity space embedding using AdaBoost

Dissimilarity Space Embedding (DSE) involves representing patterns as distances to other patterns instead of the raw features. In this work, I proposed embedding time series into DSE using Dynamic Time Warping (DTW) as a distance function. Next, we reduced the dimensionality and increased the accuracy of the DSE using AdaBoost.

Convolutional Neural Network Explainability

Book genre classification

In this research, I tackled two tasks: 1) book genre classification based on cover images and 2) understanding how the Convolutional Neural Network (CNN) was able to classify the book.

Softmax Gradient Layer-wise Relevance Propagation (SGLRP)

This research improves a popular method of Convolutional Neural Network (CNN) visualization called Layer-wise Relevance Propagation (LRP) by exploiting the gradient of softmax as the relevance signal.

  • ICCV Workshops, 2019

Publications

International Journals (Refereed)

  1. Gantugs Atarsaikhan, Brian Kenji Iwana, and Seiichi Uchida, "Guided neural style transfer for shape stylization," PLOS ONE, vol. 15, no. 6, pp. e0233489, 2020.
    [BibTeX] [PDF] [DOI]
  2. Anna Zhu, Xiongbo Lu, Xiang Bai, Seiichi Uchida, Brian Kenji Iwana, and Shengwu Xiong, "Few-Shot Text Style Transfer via Deep Feature Similarity," IEEE Transactions on Image Processing, 2020.
    [BibTeX] [DOI]
  3. Adriano Lucieri, Huzaifa Sabir, Shoaib Ahmed Siddiqui, Syed Tahseen Raza Rizvi, Brian Kenji Iwana, Seiichi Uchida, Andreas Dengel, and Sheraz Ahmed, "Benchmarking Deep Learning Models for Classification of Book Covers," SN Computer Science, vol. 1, no. 139, pp. 1--16, 2020.
    [BibTeX] [PDF] [DOI]
  4. Brian Kenji Iwana, Volkmar Frinken, and Seiichi Uchida, "DTW-NN: A novel neural network for time series recognition using dynamic alignment between inputs and weights," Knowledge-Based Systems, vol. 188, pp. 104971, 2020.
    [BibTeX] [PDF] [DOI]
  5. Brian Kenji Iwana and Seiichi Uchida, "Time series classification using local distance-based features in multi-modal fusion networks," Pattern Recognition, vol. 97, pp. 107024, 2020.
    [BibTeX] [PDF] [DOI]
  6. Yuchen Zheng, Brian Kenji Iwana, and Seiichi Uchida, "Mining the Displacement of Max-pooling for Text Recognition," Pattern Recognition, vol. 93, pp. 558-569, 2019.
    [BibTeX] [PDF] [DOI]
  7. Brian Kenji Iwana, Kaspar Riesen, Volkmar Frinken, and Seiichi Uchida, "Efficient temporal pattern recognition by means of dissimilarity space embedding with discriminative prototypes," Pattern Recognition, vol. 64, pp. 268-276, 2017.
    [BibTeX] [PDF] [DOI]
  8. Anna Zhu, Guoyou Wang, Yangbo Dong, and Brian Kenji Iwana, "Detecting text in natural scene images with conditional clustering and convolution neural network," Journal of Electronic Imaging, vol. 24, no. 5, pp. 053019, 2015.
    [BibTeX] [PDF] [DOI]

International Conferences (Refereed)

  1. Brian Kenji Iwana and Seiichi Uchida, "Time Series Data Augmentation for Neural Networks by Time Warping with a Discriminative Teacher," International Conference on Pattern Recognition (ICPR), 2021.
    [BibTeX] [PDF] [GitHub]
  2. Keisuke Kanda, Brian Kenji Iwana, and Seiichi Uchida, "What is the Reward for Handwriting? --- Handwriting Generation by Imitation Learning," International Conference on Frontiers in Handwriting Recognition (ICFHR), 2020.
    [BibTeX]
  3. Hiroki Tokunaga, Brian Kenji Iwana, Yuki Teramoto, Akihiko Yoshizawa, and Ryoma Bise, "Negative Pseudo Labeling using Class Proportion for Semantic Segmentation in Pathology," European Conference on Computer Vision (ECCV), 2020.
    [BibTeX] [PDF]
  4. Masaya Ikoma, Brian Kenji Iwana, and Seiichi Uchida, "Effect of Text Color on Word Embeddings," International Workshop on Document Analysis Systems (DAS), 2020.
    [BibTeX] [PDF]
  5. Seokjun Kang, Brian Kenji Iwana, and Seiichi Uchida, "ACMU-Net: Advanced Cascading Modular U-Nets incorporated Squeeze and Excitation Blocks," International Workshop on Document Analysis Systems (DAS), 2020.
    [BibTeX] [DOI]
  6. Gantugs Atarsaikhan, Brian Kenji Iwana, and Seiichi Uchida, "Neural Style Difference Transfer and Its Application to Font Generation," International Workshop on Document Analysis Systems (DAS), 2020.
    [BibTeX] [PDF] [DOI]
  7. Daichi Haraguchi, Shota Harada, Yuto Shinahara, Brian Kenji Iwana, and Seiichi Uchida, "Character-independent font identification," International Workshop on Document Analysis Systems (DAS), 2020.
    [BibTeX] [PDF] [DOI]
  8. Brian Kenji Iwana, Ryohei Kuroki, and Seiichi Uchida, "Explaining Convolutional Neural Networks using Softmax Gradient Layer-wise Relevance Propagation," ICCV Workshops, 2019.
    [BibTeX] [PDF] [DOI] [GitHub]
  9. Yirong Zhao and Brian Kenji Iwana, "Implementation and evaluation of classes incorporating drama approach methods for interactive learning in a primary school setting," International Conference on Education, Research and Innovation (ICERI), pp. 4007-4014, 2019.
    [BibTeX] [DOI]
  10. Seokjun Kang, Brian Kenji Iwana, Seiichi Uchida, "Cascading Modular U-Nets for Document Image Binarization," International Conference on Document Analysis and Recognition (ICDAR), pp. 675-680, 2019.
    [BibTeX] [PDF] [DOI]
  11. Kohei Baba, Seiichi Uchida, and Brian Kenji Iwana, "On the Ability of a CNN to Realize Image-to-Image Language Conversion," International Conference on Document Analysis and Recognition (ICDAR), pp. 448-453, 2019.
    [BibTeX] [PDF] [DOI]
  12. Ryo Nakao, Brian Kenji Iwana, and Seiichi Uchida, "Selective Super-Resolution for Scene Text Images," International Conference on Document Analysis and Recognition (ICDAR), pp. 401-406, 2019.
    [BibTeX] [PDF] [DOI]
  13. Taichi Sumi, Brian Kenji Iwana, Hideaki Hayashi, and Seiichi Uchida, "Modality Conversion of Handwritten Patterns by Cross Variational Autoencoders," International Conference on Document Analysis and Recognition (ICDAR), pp. 407-412, 2019.
    [BibTeX] [PDF] [DOI]
  14. Xiaomeng Wu, Akisato Kimura, Brian Kenji Iwana, Seiichi Uchida, and Kunio Kashino, "Deep Dynamic Time Warping: End-to-End Local Representation Learning for Online Signature Verification," International Conference on Document Analysis and Recognition (ICDAR), pp. 1103-1110, 2019.
    [BibTeX] [DOI]
  15. Yuchen Zheng, Wataru Ohyama, Brian Kenji Iwana, and Seiichi Uchida, "Capturing Micro Deformations from Pooling Layers for Offline Signature Verification," International Conference on Document Analysis and Recognition (ICDAR), pp. 1111-1116, 2019.
    [BibTeX] [PDF] [DOI]
  16. Brian Kenji Iwana and Seiichi Uchida, "Dynamic Weight Alignment for Temporal Convolutional Neural Networks," International Conference on Acoustics, Speech, and Signal Processing (ICASSP), pp. 3827-3831, 2019.
    [BibTeX] [PDF] [DOI]
  17. Shailza Jolly, Brian Kenji Iwana, Ryohei Kuroki, and Seiichi Uchida, "How do Convolutional Neural Networks Learn Design?," International Conference on Pattern Recognition (ICPR), pp. 1085-1090, 2018.
    [BibTeX] [PDF] [DOI]
  18. Brian Kenji Iwana, Minoru Mori, Akisato Kimura, and Seiichi Uchida, "Introducing Local Distance-based Features to Temporal Convolutional Neural Networks," International Conference on Frontiers in Handwriting Recognition (ICFHR), pp. 92-97, 2018.
    [BibTeX] [PDF] [DOI] [GitHub]
  19. Yuchen Zheng, Brian Kenji Iwana, and Seiichi Uchida, "Discovering Class-Wise Trends of Max-Pooling in Subspace," International Conference on Frontiers in Handwriting Recognition (ICFHR), pp. 98-103, 2018.
    [BibTeX] [PDF] [DOI]
  20. Gantugs Atarsaikhan, Brian Kenji Iwana, and Seiichi Uchida, "Contained Neural Style Transfer for Decorated Logo Generation," International Workshop on Document Analysis Systems (DAS), 2018.
    [BibTeX] [PDF] [DOI]
  21. Kotaro Abe, Brian Kenji Iwana, Viktor Gösta Holmér, and Seiichi Uchida, "Font Creation Using Class Discriminative Deep Convolutional Generative Adversarial Networks," Asian Conference on Pattern Recognition (ACPR), pp. 232-237, 2017.
    [BibTeX] [PDF] [DOI]
  22. Jinho Lee, Brian Kenji Iwana, Shota Ide, Hideaki Hayashi, and Seiichi Uchida, "Globally Optimal Object Tracking with Complementary Use of Single Shot Multibox Detector and Fully Convolutional Network," Pacific-Rim Symposium on Image and Video Technology (PSIVT), pp. 110-122, 2017.
    [BibTeX] [PDF] [DOI]
  23. Gantugs Atarsaikhan, Brian Kenji Iwana, Atsushi Narusawa, Keiji Yanai, and Seiichi Uchida, "Neural font style transfer," ICDAR Workshop on Machine Learning (ICDAR-WML), pp. 51-56, 2017.
    [BibTeX] [PDF] [DOI]
  24. Brian Kenji Iwana, Letao Zhou, Kumiko Tanaka-Ishii, and Seiichi Uchida, "Component Awareness in Convolutional Neural Networks," International Conference on Document Analysis and Recognition (ICDAR), pp. 394-399, 2017.
    [BibTeX] [PDF] [DOI]
  25. Seiichi Uchida, Shota Ide, Brian Kenji Iwana, and Anna Zhu, "A further step to perfect accuracy by training CNN with larger data," International Conference on Frontiers in Handwriting Recognition (ICFHR), pp. 405-410, 2016.
    [BibTeX] [PDF] [DOI]
  26. Brian Kenji Iwana, Volkmar Frinken, and Seiichi Uchida, "A Robust Dissimilarity-Based Neural Network for Temporal Pattern Recognition," International Conference on Frontiers in Handwriting Recognition (ICFHR), pp. 265-270, 2016.
    [BibTeX] [PDF] [DOI]
  27. Brian Kenji Iwana, Seiichi Uchida, Kaspar Riesen, and Volkmar Frinken, "Tackling Temporal Pattern Recognition by Vector Space Embedding," International Conference on Document Analysis and Recognition (ICDAR), pp. 816-820, 2015.
    [BibTeX] [PDF] [DOI]

Japan Domestic Journals and Conferences (Refereed and Non-Refereed)

  1. Yirong Zhao, Brian Kenji Iwana, and Kun Qian, "Drama Approach as an Educational Practice in Secondary Education: A Case Study in a Japanese Middle School," Joint Journal of the National Universities in Kyushu, Education and Humanities, vol. 6, no. 1/2, pp. 4--25, 2020.
    [BibTeX] [PDF]
  2. Kohei Baba, Brian Kenji Iwana, and Seiichi Uchida, "画像に基づく言語変換," Meeting on Image Recognition and Understanding (MIRU), 2019.
  3. Brian Kenji Iwana, and Seiichi Uchida, "Judging a Book by its Cover," Kyushu University Education Reform Symposium, 2018.
  4. Letao Zhou, Brian Kenji Iwana, Kumiko Tanaka-Ishii, and Seiichi Uchida, "Component Detection in Chinese Character Using CNN," IEICE Technical Report, 2017.
  5. Brian Kenji Iwana and Seiichi Uchida, "Judging a Book by its Cover," Meeting on Image Recognition and Understanding (MIRU), 2016.

Preprints (Non-Refereed)

  1. Brian Kenji Iwana and Seiichi Uchida, "An Empirical Survey of Data Augmentation for Time Series Classification with Neural Networks," ArXiv, 2020.
    [BibTeX] [arXiv] [GitHub]
  2. Joonho Lee, Kumar Shridhar, Brian Kenji Iwana, Seokjun Kang, and Seiichi Uchida, "ProbAct: A Probabilistic Activation Function for Deep Neural Networks," ArXiv, no. 1905.10761, 2019.
    [BibTeX] [arXiv]
  3. Brian Kenji Iwana, Syed Tahseen Raza Rizvi, Sheraz Ahmed, Andreas Dengel, and Seiichi Uchida, "Judging a Book by its Cover," ArXiv, no. 1610.09204, 2017.
    [BibTeX] [arXiv] [GitHub]
  4. Jinho Lee, Brian Kenji Iwana, Shouta Ide, and Seiichi Uchida, "Globally Optimal Object Tracking with Fully Convolutional Networks," ArXiv, no. 1612.08274, 2016.
    [BibTeX] [arXiv]

Activities

International Journals

  1. Reviewer, Elsevier Pattern Recognition
  2. Reviewer, Elsevier Neural Networks
  3. Reviewer, Elsevier Knowledge-Based Systems
  4. Reviewer, Elsevier Applied Soft Computing
  5. Reviewer, Elsevier Automation in Construction
  6. Reviewer, Elsevier Pattern Recognition Letters
  7. Reviewer, IEEE Trans. Systems, Man and Cybernetics: Systems
  8. Reviewer, IEEE Access
  9. Reviewer, IEICE Trans. Information and Systems

International Conferences

  1. Program Committee, Int. Conf. on Frontiers of Handwriting Recognition, 2020
  2. Program Committee, Int. Workshop on Document Analysis Systems, 2020
  3. Program Committee, ICDAR Workshop on Machine Learning, 2019
  4. Session Chair, Joint Workshop on Machine Perception and Robotics, 2018
  5. Reviewer, Int. Conf. on Pattern Recognition, 2018
  6. Reviewer, Int. Workshop on Document Analysis Systems, 2018
  7. Program Committee, ICDAR Workshop on Machine Learning, 2017
  8. Sub-Reviewer, Int. Conf. on Document Analysis and Recognition, 2015

Scholar

  1. Completion of the Graduate Education and Research Training Program in Decision Science for a Sustainable Society (九州大学 持続可能な社会を拓く決断科学大学院プログラム), Kyushu University, Japan
    [Link]

Awards

  1. Best Interactive Session, Kohei Baba, Brian Kenji Iwana, and Seiichi Uchida, "画像に基づく言語変換," Meeting on Image Recognition and Understanding (MIRU), Osaka, Japan, 2019
  2. Best Student Paper Award (Track), Shailza Jolly, Brian Kenji Iwana, Ryohei Kuroki, and Seiichi Uchida, "How do Convolutional Neural Networks Learn Design?," Int. Conf. on Pattern Recognition, Beijing, China, 2018
  3. Bronze Prize, Brian Kenji Iwana, Seiichi Uchida, "Judging a Book by its Cover," Kyushu University Education Reform Symposium, Fukuoka, Japan, 2017

Teaching

  1. Lecturer, "Pattern Recognition and Data Processing," Kyushu University, Japan, 2020, 2019, 2018
  2. Invited Lecture, "Time Series Classification with Distance-based Neural Networks," NTT Communication Labs, Japan, 2018
  3. Guest Lecture, "Image Processing," Kyushu University, Japan, 2017
  4. Guest Lecture, "Pattern Recognition," Kyushu University, Japan, 2016

Curriculum Vitae

Education:

Ph.D., Information Science

Kyushu University, Fukuoka city, Fukuoka, Japan

B.S., Computer Engineering

University of California Irvine, Irvine, California, USA

Employment:

Assistant Professor

Information Science and Electrical Engineering, Kyushu University, Fukuoka city, Fukuoka, Japan
  • Research Assistant Professor at the Human Interface Laboratory.
  • Research Interest: Pattern Recognition, Machine Learning, Artificial Neural Networks, Document Analysis and Recognition, Time Series Recognition

Software Developer

National Aeronautics and Space Administration, Mountain View, California, USA
  • Developed data management and data interfacing applications for NASA scientists.
  • Skills: PHP, CodeIgniter, Bootstrap 3, MySQL, Jquery, Witango, FileNet eForms

Software Developer

Talisman LBS, LLC, Honolulu, Hawaii, USA
  • Worked as a full stack application developer.
  • Skills - Ruby on Rails, MySQL, HTML, Prototype JS, Apache

IT Consultant

Elite Development Group, Aliso Viejo, California, USA
  • Set up, maintain, and troubleshoot networks and domains for small to medium size businesses on multiple OS platforms.
  • Skills: Windows Server 2000, Active Directory, security, networking