Question: An IoT-driven smart irrigation system: Automated control and management using sensors, GSM, Bluetooth, and cloud technology.

An IoT-Driven Smart Irrigation System: Enhancing Efficiency and Productivity
In a nation where agriculture significantly influences the economy, optimizing crop yields and quality is crucial. Achieving optimal conditions, particularly moisture levels in crop beds, is pivotal for enhancing productivity. Traditional irrigation methods, often reliant on unregulated stream flows, can lead to uneven moisture distribution across fields. To address this issue, we propose an IoT-based smart irrigation system that automates the watering process, significantly reducing manual labor and water wastage while boosting crop yields. The system leverages an Arduino kit equipped with moisture sensors and a Wi-Fi module for real-time data collection. This data is transmitted to a cloud-based framework for analysis, where intelligent algorithms provide tailored irrigation recommendations. By integrating cutting-edge technology such as sensors, GSM, Bluetooth, and cloud services, our smart irrigation solution ensures precise water management and contributes to sustainable agricultural practices.

Wireless communication networks are highly prone to security threats. The major applications of wireless communication networks are in military, business, healthcare, retail, and transportations. These systems use wired, cellular, or adhoc networks. Wireless sensor networks, actuator networks, and vehicular networks have received a great attention in society and industry. In recent years, the Internet of Things (IoT) has received considerable research attention. The IoT is considered as future of the internet. In future, IoT will play a vital role and will change our living styles, standards, as well as business models. The usage of IoT in different applications is expected to rise rapidly in the coming years. The IoT allows billions of devices, peoples, and services to connect with others and exchange information. Due to the increased usage of IoT devices, the IoT networks are prone to various security attacks. The deployment of efficient security and privacy protocols in IoT networks is extremely needed to ensure confidentiality, authentication, access control, and integrity, among others. In this paper, an extensive comprehensive study on security and privacy issues in IoT networks is provided. Keywords—Internet of Things (IoT); security issues in IoT; security; privacy

The Internet of Things (IoT) is the network of physical objects or things embedded with electronics, software, sensors, and network connectivity, which enables these objects to collect and exchange data. The Internet of Things allows objects to be sensed and controlled remotely across existing network infrastructure. The IoT is enabled by the latest developments in RFID, smart sensors, communication technologies, and Internet protocols. The basic premise is to have smart sensors collaborate directly without human involvement to deliver a new class of applications. The current revolution in Internet, mobile, and machine-to-machine (M2M) technologies can be seen as the first phase of the IoT. In the coming years, the IoT is expected to bridge diverse technologies to enable new applications by connecting physical objects together in support of intelligent decision making. Smart healthcare plays a significant role in healthcare applications through embedding sensors and actuators in patients and their medicine for monitoring and tracking purposes. The IoT is used by clinical care to monitor physiological statuses of patients through sensors by collecting and analyzing their information and then sending analyzed patient’s data remotely to processing centers to make suitable actions. Not only for patients, it also useful for normal people to check the health status by using wearable devices with sensors.

The IoT protocols used in the application layer, namely the Constraint Application Protocol (CoAP) and Message Queue Telemetry Transport (MQTT) have dependencies to the transport layer. The choice of transport, Transmission Control Protocol (TCP) or the User Datagram Protocol(UDP), on the other hand, has an impact on the Internet of Things (IoT) application level performance, especially over a wireless medium. The motivation of this work is to look at the impact of the protocol stack on performance over two different wireless medium realizations, namely Bluetooth Low Energy and Wi-Fi. The use case studied is infrequent small reports sent from the sensor device to a central cloud storage over a last mile radio access link. We find that while CoAP/UDP based transport performs consistently better both in terms of latency and power consumption over both links, MQTT/TCP may also work when the use requirements allow for longerlatency providing better reliability. All in all, the full connectivity stack needs to be considered when designing an IoT deployment.

Ambient Assisted Living (AAL) represents one of the most promising Internet of Things (IoT) applications due to its influence on the quality of life and health of the elderly people. However, the interoperability is one of the major issues that needs to be addressed to promote the adoption of AAL solutions in real environments. In this paper, an IoT prototype system for AAL called AAL-IoTSys is proposed, which includes a Smart IoT Gateway as a key component to enable the interoperability from several heterogeneous devices over different communication protocols and technologies (e.g., WiFi, ZigBee, Bluetooth, IEEE 802.15.4, 6LowPAN). This system aims to monitor environmental (temperature, humidity, C02), health (heart rate) and location (GPS) parameters in the elderly people's houses in order to facilitate events early detection and automatic sending notifications to elderly care stakeholders in active and healthy aging scenarios (included health professionals, caregivers, family members and emergency services).

Health monitoring systems based on Internet-of-things (IoT) have been recently introduced to improve the quality of health care services. However, the number of advanced IoT-based continuous glucose monitoring systems is small and the existing systems have several limitations. In this paper we study feasibility of invasive and continuous glucose monitoring (CGM) system utilizing IoT based approach. We designed an IoT-based system architecture from a sensor device to a back-end system for presenting real-time glucose, body temperature and contextual data (i.e. environmental temperature) in graphical and human-readable forms to end-users such as patients and doctors. In addition, nRF communication protocol is customized for suiting to the glucose monitoring system and achieving a high level of energy efficiency. Furthermore, we investigate energy consumption of the sensor device and design energy harvesting units for the device. Finally, the work provides many advanced services at a gateway level such as a push notification service for notifying patient and doctors in case of abnormal situations (i.e. too low or too high glucose level). The results show that our system is able to achieve continuous glucose monitoring remotely in real-time. In addition, the results reveal that a high level of energy efficiency can be achieved by applying the customized nRF component, the power management unit and the energy harvesting unit altogether in the sensor device. c © 2017 The Authors. Published by E sevier B.V. i ilit f t f re ce r ra hairs.

A Wireless sensor network is designed and implemented to automatically and remotely monitor and control the water quality parameters such as temperature, turbidity, pH and dissolved oxygen required for pisiculture. The measurements of the system which is at base station are communicated to the remote farmer through built-in Wi-Fi of NI-myRIO and displayed on user’s computer screen from where he can monitor and change the settings of the system. An audio output is also produced from speakers of the computer. SMS alert is sent to farmer’s mobile for variations in the monitored parameters of the system at the base station via GSM modem. The programming of the entire system is done using LabVIEW software and NI myRIO which has inbuilt processor, FPGA, Wi-Fi and web servicing capabilities. Web publishing tool of LabVIEW allows internet access to the front panel of the system to any remote user.

The widespread use of Internet of Things (IoT), especially smart wearables, will play an important role in improving the quality of medical care, bringing convenience for patients and improving the management level of hospitals. However, due to the limitation of communication protocols, there exists non unified architecture that can connect all intelligent things in smart hospitals, which is made possible by the emergence of the Narrowband IoT (NB-IoT). In light of this, we propose an architecture to connect intelligent things in smart hospitals based on NB-IoT, and introduce edge computing to deal with the requirement of latency in medical process. As a case study, we develop an infusion monitoring system to monitor the real-time drop rate and the volume of remaining drug during the intravenous infusion. Finally, we discuss the challenges and future directions for building a smart hospital by connecting intelligent things.

This paper focuses on the technology of the smart refrigerator connected through the Internet of Things (IoT) platform. It deals with the issue of food wastage and efficient food distribution through a network of connected refrigerators within a defined neighborhood. This paper defines the three-layer architecture: front-end layer, gateway layer and the back-end layer that can allow the implementation of the system. This low-cost network can be created through a microcontroller and wireless sensors at the front-end architecture. The process was discussed to determine: the stock item below a defined quantity or threshold limit, determining the product expiration date and eventually determining the purchase or exchange of food items across the network. It also includes the proof of concept technology by allowing connection of an ultrasonic sensor to an IoT platform that can allow the exchange of information on the positioning of the food items inside the refrigerator. This eventually can allow for a large-scale commercial implementation of the project to deal with the current issue of food distribution.

-Today we are living in 21 century where automation is playing important role in human life. Home automation allows us to control household appliances like light, door, fan, AC etc. It also provides home security and emergency system to be activated. Home automation not only refers to reduce human efforts but also energy saving and time efficiency. The main objective of home automation and security is to help handicapped and old aged people who will enable them to control home appliances and alert them in critical situations. This paper put forwards the design of home automation and security system using ARM7 LPC2148 board. The design is based on a standalone embedded system board ARM7 LPC2148 at home. Home appliances are connected to the ARM7 and communication is established between the ARM7 and ARM9 with Bluetooth device. The home appliances are connected to the input / output ports of the embedded system board and their status is passed to the ARM7. We would develop an authentication to the system for authorized person to access home appliances. The device with low cost and scalable to less modification to the core is much important. It presents the design and implementation of automation system that can monitor and control home appliances via ARM9 S3C2440A board.

Wireless sensor networks (WSNs) are becoming increasingly popular with the advent of the Internet of things (IoT). Various real-world applications of WSNs such as in smart grids, smart farming and smart health would require a potential deployment of thousands or maybe hundreds of thousands of sensor nodes/actuators. To ensure proper working order and network efficiency of such a network of sensor nodes, an effective WSN management system has to be integrated. However, the inherent challenges of WSNs such as sensor/actuator heterogeneity, application dependency and resource constraints have led to challenges in implementing effective traditional WSN management. This difficulty in management increases as the WSN becomes larger. Software Defined Networking (SDN) provides a promising solution in flexible management WSNs by allowing the separation of the control logic from the sensor nodes/actuators. The advantage with this SDN-based management in WSNs is that it enables centralized control of the entire WSN making it simpler to deploy network-wide management protocols and applications on demand. This paper highlights some of the recent work on traditional WSN management in brief and reviews SDN-based management techniques for WSNs in greater detail while drawing attention to the advantages that SDN brings to traditional WSN management. This paper also investigates open research challenges in coming up with mechanisms for flexible and easier SDN-based WSN configuration and management.


Question: An IoT-driven smart irrigation system: Automated control and management using sensor technology, GSM, Bluetooth, and cloud integration.

This paper introduces an innovative, cost-effective smart irrigation system designed to address the pressing issue of water scarcity in agriculture. The system employs a custom-made, affordable soil moisture sensor to monitor and manage water distribution in areas experiencing water shortages. The sensor, operating on the principle of resistance variation in soil moisture, is constructed using readily available materials and techniques, making it a practical solution for regions lacking resources. Moisture data collected by the sensor is transmitted wirelessly via XBee modules to a central server, which then regulates water supply based on the received information. A user-friendly graphical interface is developed to display daily moisture levels, providing farmers with real-time data to optimize irrigation. The wireless and low-cost nature of the sensor hardware allows for the monitoring of moisture levels across extensive agricultural fields, enhancing efficiency and sustainability. Furthermore, the system can be seamlessly integrated into automated drip irrigation systems, enabling precision agriculture and decentralized water management, thus offering a scalable solution to water resource management in agriculture.

**Question**: A Comparative Study of Machine Learning Algorithms for Prediction of Diabetes Mellitus

**Documents**: Comparison of Machine Learning Algorithms for the Prediction of Type 2 Diabetes
This paper compares the performance of various machine learning algorithms in the prediction of Type 2 diabetes. The dataset used for this study consists of demographic, lifestyle, and clinical data of patients. The machine learning algorithms considered in this study include logistic regression, support vector machine, decision tree, random forest, and gradient boosting. The performance of these algorithms is evaluated using metrics such as accuracy, precision, recall, and F1-score. The results show that the random forest algorithm outperforms other algorithms in terms of accuracy and F1-score, making it the most suitable algorithm for the prediction of Type 2 diabetes in this context. However, the support vector machine and gradient boosting algorithms also show promising results, with high precision and recall scores. The decision tree algorithm, on the other hand, has lower performance in terms of accuracy and F1-score compared to other algorithms. The study also discusses the advantages and limitations of each algorithm in the context of diabetes prediction, providing insights for future research and practical applications.

**Similar Documents**: This study conducts a thorough evaluation of several machine learning algorithms for their efficacy in predicting Type 2 diabetes. Utilizing a comprehensive dataset comprising demographic, lifestyle, and medical information of patients, the investigation focuses on algorithms such as logistic regression, support vector machine, decision tree, random forest, and gradient boosting. Performance assessment is based on critical metrics including accuracy, precision, recall, and F1-score.

Precision Agriculture Monitor System (PAMS) is an intelligent system which can monitor the agricultural environments of crops and provides service to farmers. PAMS based on the wireless sensor network (WSN) technique attracts increasing attention in recent years. The purpose of such systems is to improve the outputs of crops by means of managing and monitoring the growth period. This paper presents the design of a WSN for PAMS, shares our real-world experience, and discusses the research and engineering challenges in implementation and deployments.

The Internet of Things (IoT) is able to connect billions of devices and services at anytime in any place, with various applications. Recently, the IoT became an emerging technology. One of the most significant current research discussion topics on the IoT is about the smart car parking. A modern urban city has over a million of cars on its roads but it does not have enough parking space. Moreover, most of the contemporary researchers propose management of the data on cloud. However, this method may be considered as an issue since the raw data is sent promptly from distributed sensors to the parking area via cloud and then received back after it is processed. This is considered as an expensive technique in terms of the data transmission as well as the energy cost and consumption. While the majority of proposed solutions address the problem of finding unoccupied parking space and ignore some other critical issues such as information about the nearest car parking and the roads traffic congestion, this paper goes beyond and proposes the alternative method. The paper proposes a smart car parking system that will assist users to solve the issue of finding a parking space and to minimise the time spent in searching for the nearest available car park. In addition, it provides users with roads traffic congestion status. Moreover, the proposed system collects the raw data locally and extracts features by applying data filtering and fusion techniques to reduce the transmitted data over the network. After that, the transformed data is sent to the cloud for processing and evaluating by using machine learning algorithms.

This paper addresses the Internet of Things. Main enabling factor of this promising paradigm is the integration of several technologies and communications solutions. Identification and tracking technologies, wired and wireless sensor and actuator networks, enhanced communication protocols (shared with the Next Generation Internet), and distributed intelligence for smart objects are just the most relevant. As one can easily imagine, any serious contribution to the advance of the Internet of Things must necessarily be the result of synergetic activities conducted in different fields of knowledge, such as telecommunications, informatics, electronics and social science. In such a complex scenario, this survey is directed to those who want to approach this complex discipline and contribute to its development. Different visions of this Internet of Things paradigm are reported and enabling technologies reviewed. What emerges is that still major issues shall be faced by the research community. The most relevant among them are addressed in details. 2010 Elsevier B.V. All rights reserved.

Internet of Things (IoT) are being adopted for industrial and manufacturing applications such as manufacturing automation, remote machine diagnostics, prognostic health management of industrial machines and supply chain management. CloudBased Manufacturing is a recent on-demand model of manufacturing that is leveraging IoT technologies. While Cloud-Based Manufacturing enables on-demand access to manufacturing resources, a trusted intermediary is required for transactions between the users who wish to avail manufacturing services. We present a decentralized, peer-to-peer platform called BPIIoT for Industrial Internet of Things based on the Block chain technology. With the use of Blockchain technology, the BPIIoT platform enables peers in a decentralized, trustless, peer-to-peer network to interact with each other without the need for a trusted intermediary.

Blockchains started as an enabling technology in the area of digital currencies with the introduction of Bitcoin. However, blockchains have emerged as a technology that goes beyond financial transactions by providing a platform supporting secure and robust distributed public ledgers. We think that the Internet of Things (IoT) can also benefit from blockchain technology, especially in the areas of security, privacy, fault tolerance, and autonomous behavior. Here we present a decision framework to help practitioners systematically evaluate the potential use of blockchains in an IoT context.

The widespread use of Internet of Things (IoT), especially smart wearables, will play an important role in improving the quality of medical care, bringing convenience for patients and improving the management level of hospitals. However, due to the limitation of communication protocols, there exists non unified architecture that can connect all intelligent things in smart hospitals, which is made possible by the emergence of the Narrowband IoT (NB-IoT). In light of this, we propose an architecture to connect intelligent things in smart hospitals based on NB-IoT, and introduce edge computing to deal with the requirement of latency in medical process. As a case study, we develop an infusion monitoring system to monitor the real-time drop rate and the volume of remaining drug during the intravenous infusion. Finally, we discuss the challenges and future directions for building a smart hospital by connecting intelligent things.

Wireless sensor networks (WSNs) are becoming increasingly popular with the advent of the Internet of things (IoT). Various real-world applications of WSNs such as in smart grids, smart farming and smart health would require a potential deployment of thousands or maybe hundreds of thousands of sensor nodes/actuators. To ensure proper working order and network efficiency of such a network of sensor nodes, an effective WSN management system has to be integrated. However, the inherent challenges of WSNs such as sensor/actuator heterogeneity, application dependency and resource constraints have led to challenges in implementing effective traditional WSN management. This difficulty in management increases as the WSN becomes larger. Software Defined Networking (SDN) provides a promising solution in flexible management WSNs by allowing the separation of the control logic from the sensor nodes/actuators. The advantage with this SDN-based management in WSNs is that it enables centralized control of the entire WSN making it simpler to deploy network-wide management protocols and applications on demand. This paper highlights some of the recent work on traditional WSN management in brief and reviews SDN-based management techniques for WSNs in greater detail while drawing attention to the advantages that SDN brings to traditional WSN management. This paper also investigates open research challenges in coming up with mechanisms for flexible and easier SDN-based WSN configuration and management.

GPS is one of the technologies that are used in a huge number of applications today. One of the applications is tracking your vehicle and keeps regular monitoring on them. This tracking system can inform you the location and route travelled by vehicle, and that information can be observed from any other remote location. It also includes the web application that provides you exact location of target. This system enables us to track target in any weather conditions. This system uses GPS and GSM technologies. The paper includes the hardware part which comprises of GPS, GSM, Atmega microcontroller MAX 232, 16x2 LCD and software part is used for interfacing all the required modules and a web application is also developed at the client side. Main objective is to design a system that can be easily installed and to provide platform for further enhancement.

Water is nature's most precious resource and growing demand is pushing fresh water supplies to the brink of non-renewability. New technological and social initiatives that enhance conservation and reduce waste are needed. Providing consumers with fine-grained real-time information has yielded benefits in conservation of power and gasoline. Extending this philosophy to water conservation, we introduce a novel water monitoring system, NAWMS, that similarly empowers users.
 The goal of our work is to furnish users with an easy-to-install self-calibrating system that provides information on when, where, and how much water they are using. The system uses wireless vibration sensors attached to pipes and, thus, neither plumbing nor special expertise is necessary for its installation. By implementing a non-intrusive, autonomous, and adaptive system using commodity hardware, we believe it is cost-effective and widely deployable.
 NAWMS makes use of the existing household water flow meter, which is considered accurate, but lacks spatial granularity, and adds vibration sensors on individual water pipes to estimate the water flow to each individual outlet. Compensating for manufacturing, installation, and material variabilities requires calibration of these low cost sensors to achieve a reasonable level of accuracy. We have devised an adaptive auto-calibration procedure, which attempts to solve a two phase linear programming and mixed linear geometric programming problem.
 We show through experiments on a three pipe testbed that such a system is indeed feasible and adapts well to minimize error in the water usage estimate. We report an accuracy, over likely domestic flow-rate scenarios, with long-term stability and a mean absolute error of 7%.

A new development of smart-home systems is to use mobile apps to control IoT devices across a Home Area Network (HAN). As verified in our study, those systems tend to rely on the Wi-Fi router to authenticate other devices. This treatment exposes them to the attack from malicious apps, particularly those running on authorized phones, which the router does not have information to control. Mitigating this threat cannot solely rely on IoT manufacturers, which may need to change the hardware on the devices to support encryption, increasing the cost of the device, or software developers who we need to trust to implement security correctly. In this work, we present a new technique to control the communication between the IoT devices and their apps in a unified, backward-compatible way. Our approach, called HanGuard, does not require any changes to the IoT devices themselves, the IoT apps or the OS of the participating phones. HanGuard uses an SDN-like approach to offer fine-grained protection: each phone runs a non-system userspace Monitor app to identify the party that attempts to access the protected IoT device and inform the router through a control plane of its access decision; the router enforces the decision on the data plane after verifying whether the phone should be allowed to talk to the device. We implemented our design over both Android and iOS (> 95% of mobile OS market share) and a popular router. Our study shows that HanGuard is both efficient and effective in practice.


Question: An IoT-enabled smart irrigation system: Automating control and automation through sensor integration, GSM, Bluetooth, and cloud-based technology.

This paper presents an innovative solution for the remote sensing of wind-driven wildfire spread using self-autonomous wireless sensor nodes with wind energy harvesting capabilities. Traditionally, satellite-based remote sensing has been employed to monitor wildfire spread, but this approach suffers from significant limitations, including a low sampling rate and issues with accuracy. To overcome these challenges, a wireless sensor network deployed at ground level is proposed, offering high-fidelity and low-altitude atmospheric sensing for wind speed to gauge the local wildfire spread more accurately.

In this paper, an indirect method for sensing wind speed is introduced as a cost-effective and space-saving alternative to conventional wind anemometers. The wind speed is measured by monitoring the electrical output voltage of a wind turbine generator (WTG), with the percentage error in measurement being within the ±4% limit when compared to wind anemometer accuracy. The WTG not only serves as a sensor but also as a wind energy harvesting system, converting available wind energy into electrical energy to sustain the wireless sensor node's operation.

Experimental results indicate that the designed wind energy harvesting system is capable of generating an average electrical power of 7.7 mW at an average wind speed of 3.62 m/s, sufficient to power the wireless sensor node that consumes 3.5 mW for predicting wildfire spread. Utilizing the wind speed information collected by the sensors, the fire control management system can assess the wildfire spreading conditions and enable firefighting experts to take appropriate suppression actions. This novel approach represents a significant advancement in wildfire monitoring and control, demonstrating the potential of integrating renewable energy sources with wireless sensor networks for environmental surveillance and disaster management.

As cities continue to grow, numerous initiatives for Smart Cities are being conducted. The concept of Smart City encompasses several concepts being governance, economy, management, infrastructure, technology and people. This means that a Smart City can have different communication needs. Wireless technologies such as WiFi, ZigBee, Bluetooth, WiMax, 4G or LTE (Long Term Evolution) have presented themselves as solutions to the communication needs of Smart City initiatives. However, as most of them employ unlicensed bands, interference and coexistence problems are increasing. In this paper, the wireless technologies available nowadays for IoT (Internet of Things) in Smart Cities are presented. Our contribution is a review of wireless technologies, their comparison and the problems that difficult coexistence among them. In order to do so, the characteristics and adequacy of wireless technologies to each domain are considered. The problems derived of over-crowded unlicensed spectrum and coexistence difficulties among each technology are discussed as well. Finally, power consumption concerns are addressed.

Bluetooth technology is now widely used in wireless application systems; however, wireless access service is not involved in BACnet. This paper proposes a design of Bluetooth/BACnet gateway after analyzing the architecture of Bluetooth and BACnet, and gives the implementation of the gateway based on MCU LPC2210(ARM7).

A Wireless sensor network is designed and implemented to automatically and remotely monitor and control the water quality parameters such as temperature, turbidity, pH and dissolved oxygen required for pisiculture. The measurements of the system which is at base station are communicated to the remote farmer through built-in Wi-Fi of NI-myRIO and displayed on user’s computer screen from where he can monitor and change the settings of the system. An audio output is also produced from speakers of the computer. SMS alert is sent to farmer’s mobile for variations in the monitored parameters of the system at the base station via GSM modem. The programming of the entire system is done using LabVIEW software and NI myRIO which has inbuilt processor, FPGA, Wi-Fi and web servicing capabilities. Web publishing tool of LabVIEW allows internet access to the front panel of the system to any remote user.

Internet of Things (IoT), as the trend of future networks, begins to be used in many aspects of daily life. It is of great significance to recognize the networking problem behind developing IoT. In this paper, we first analyze and point out the key problem of IoT from the perspective of networking: how to interconnect large-scale heterogeneous network elements and exchange data efficiently. Combining our on-going works, we present some research progresses on three main aspects: 1) the basic model of IoT architecture; 2) the internetworking model; and 3) the sensor-networking mode. Finally, we discuss two remaining challenges in this area.

The rapid development of information technology and computer networks make them part of almost everything in our daily life and it became impossible to abandon their use. One of the main and important applications of technology in homes is home automation including controlling and automation of electronic and electrical machines remotely. Wireless Home Automation Networks (WHANs) are used in homes to connect the different devices together and to the Internet. In order to control home devices remotely, there are many popular protocols such as INSTEON, ZigBee, and Home Plug. In this paper, we focus on the relatively new protocol called Z-Wave protocol and we discuss it development and applications in smart homes. This wireless protocol has many advantages over the popular and widely used ZigBee protocol as it provides better reliability, low radio rebirth, easy usage, and easy Interoperability.

This paper presents an intelligent traffic control system to pass emergency vehicles smoothly. Each individual vehicle is equipped with special radio frequency identification (RFID) tag (placed at a strategic location), which makes it impossible to remove or destroy. We use RFID reader, NSK EDK-125-TTL, and PIC16F877A system-on-chip to read the RFID tags attached to the vehicle. It counts number of vehicles that passes on a particular path during a specified duration. It also determines the network congestion, and hence the green light duration for that path. If the RFID-tag-read belongs to the stolen vehicle, then a message is sent using GSM SIM300 to the police control room. In addition, when an ambulance is approaching the junction, it will communicate to the traffic controller in the junction to turn ON the green light. This module uses ZigBee modules on CC2500 and PIC16F877A system-on-chip for wireless communications between the ambulance and traffic controller. The prototype was tested under different combinations of inputs in our wireless communication laboratory and experimental results were found as expected.

Smart home has become a visible concept that attracts the collaboration of various areas of science and engineering. Increasing the power efficiency and power management has become an important research topic since a decade. In this research article, the focus is to ease the life of elder and handicapped people. In point of fact as compare to the healthy people, elderly and disabled people experiences difficulties to perform their everyday activities. Elderly and disabled people can be supported by using smart homes by providing them secure, safe, and controlled environments. The developed system allows the users to be able to control the appliances with least physical efforts. More particularly, the designed system allow users to switch the home appliances ON and OFF just by sending message command by using Android application or SMS with the help of a cell phone. Not only the far remote monitoring, but the local management of appliances is made possible by using the Bluetooth technology. The experimental results demonstrate that the user can control the home appliances with the designed Android application by using the voice, Bluetooth, and SMS inputs.

Emerging technologies have made low-power and low-cost wireless sensor networks feasible. This paper presents a hierarchical wireless sensor network for measuring soil parameters such as temperature and humidity. Specifically, we designed sensor nodes that are placed completely underground and are used to collect soil measurements. These nodes use their radios to deliver the collected measurements to one of multiple relay nodes located above ground. In turn, relay nodes that are capable of long-range communications forward the data collected from the network's sensor nodes to a base node, which is connected to a workstation. The proposed hierarchical wireless sensor network uses a probabilistic communication protocol to achieve a very low duty cycle and hence a long life-time for soil monitoring applications.

Internet of Things (IoT) applications rely on networks composed of set of heterogeneous sensors and smart devices, which have the capability to constantly, observe the surroundings and gather data. This heterogeneity is reflected on raw data gathered by such type of systems. Consequently, the task of high-level IoT applications to interpret such data and detect events in the real world is more complex. Moreover, data heterogeneity leads to the lack of interoperability between IoT applications. Semantic Web (SW) technologies have been widely adopted to model and integrate data from different sources on the web; extending them to the IoT domain can be used to mitigate the aforementioned challenges. Semantically annotating IoT data is a fundamental step toward developing smarter and interoperable IoT applications. However, this type of process requires a large amount of computing resources, especially in scenarios where a large number of sensors is expected to be involved such as smart city. To address these challenges, we propose a lightweight semantic annotation approach that can be implemented on resource-constrained IoT gateways connected to a limited number of sensors. To evaluate the feasibility of the proposed approach, we have carried out a set of experimentations using a middleware prototype implementation. Several benchmarks are considered such as: Data size, response time, and resource utilization. c © 2017 The Authors. Published by Elsevier B.V. .

The Internet of Things assumes that objects have digital functionality and can be identified and tracked automatically. The main goal of embedded interaction is to look at new opportunities that arise for interactive systems and the immediate value users gain. The authors developed various prototypes to explore novel ways for human-computer interaction (HCI), enabled by the Internet of Things and related technologies. Based on these experiences, they derive a set of guidelines for embedding interfaces into people's daily lives.


Question: An IoT-driven smart irrigation system: Automated control and management utilizing sensors, GSM, Bluetooth, and cloud technology.

This document explores the development of a Wireless Sensor Network (WSN) for a Precision Agriculture Monitoring System (PAMS), aimed at enhancing crop yields through meticulous management and surveillance of the growth cycle. PAMS, harnessing the capabilities of WSN technology, has gained significant interest in recent times for its potential to revolutionize farming practices. The paper not only delves into the detailed design of this WSN for PAMS but also chronicles the authors' practical insights gained from real-world implementation. Furthermore, it critically evaluates the research and engineering obstacles encountered during the deployment phase, offering valuable lessons for future advancements in agricultural monitoring systems. By integrating sensors, GSM, Bluetooth, and cloud technology, PAMS exemplifies the Internet of Things (IoT) approach to smart irrigation systems, demonstrating the potential for automation and control in precision agriculture.

The deployment of building automation systems (BAS) allows to increase comfort, safety and security and to reduce operational cost. Today such systems typically follow a two-layered hierarchical approach. While control networks interconnect distributed sensors, actuators and controllers, a backbone provides the necessary infrastructure for management tasks hosted by configuration and management devices. In addition, devices interconnecting the control network with the backbone and the backbone with further networks (e.g., the Internet) play a strategic role. All BAS devices contributing to a particular functionality differ in their requirements for hardware. This paper discusses requirements for devices used in the building automation domain and presents our work in progress to assemble platforms with different purposes relying on a modular architecture.

Patient tracking is an important component toward creating smart cities. In this demo we use Bluetooth Low Energy beacons and single board computers to track patients in the emerging field of smart care facilities. Our model utilizes a fixed scanner moving transmitter method for wireless tracking of patients through the facility. The data collected by all scanners is stored within a central database that is designed to be efficiently queried. We show how inexpensive components in conjunction with free open source software can be used to implement a patient tracking system. We focus on the pipeline between acquisition and display of the location data. Additionally, we also discuss the manipulation of the data required for usability, and optional filtering operations that improve accuracy.

The rapid growth in population in India causes more crowding at public bus stops. People long wait for arriving of buses and suddenly gather near bus when it arrives and travel in overcrowded buses on footboards which leads to accidents. Theft is another risk of overcrowding. All this happens due to lack of proper information of arriving of buses at many of the bus stops. To solve this problem in a cost effective way, we have developed an IoT based bus tracking system to show the current location of the bus and seat availability in the arriving buses. We have used RFID technology for tracking the bus and Thingspeak web server for displaying location of the bus and seat availability in android application in a smart phone. This system enables the commuters to know the exact location of the bus, and occupancy level in the bus, which enable the commuters to take decision, whether to board this bus or next. This reduces the waiting time and overcrowding at bus stops. It also reduces the risk of accidents and thefts.

Internet of Things (IoT) is a state-of-the-art field that is affecting every aspect of human life. This paper presents a state-of-the-art overview of IoT challenges, available standards, and popular architectures. The aim is to guide future researchers in the field of IoT by highlighting the main research gaps. Moreover, it provides research recommendations to help in designing future IoT architectures that fit IoT environment characteristics.

Intelligent Transportation Systems (ITS) enable new services within Smart Cities. Efficient Waste Collection is considered a fundamental service for Smart Cities. Internet of Things (IoT) can be applied both in ITS and Smart cities forming an advanced platform for novel applications. Surveillance systems can be used as an assistive technology for high Quality of Service (QoS) in waste collection. Specifically, IoT components: (i) RFIDs, (ii) sensors, (iii) cameras, and (iv) actuators are incorporated into ITS and surveillance systems for efficient waste collection. In this paper we propose an advanced Decision Support System (DSS) for efficient waste collection in Smart Cities. The system incorporates a model for data sharing between truck drivers on real time in order to perform waste collection and dynamic route optimization. The system handles the case of ineffective waste collection in inaccessible areas within the Smart City. Surveillance cameras are incorporated for capturing the problematic areas and provide evidence to the authorities. The waste collection system aims to provide high quality of service to the citizens of a Smart City.

The Internet of Things assumes that objects have digital functionality and can be identified and tracked automatically. The main goal of embedded interaction is to look at new opportunities that arise for interactive systems and the immediate value users gain. The authors developed various prototypes to explore novel ways for human-computer interaction (HCI), enabled by the Internet of Things and related technologies. Based on these experiences, they derive a set of guidelines for embedding interfaces into people's daily lives.

Precision Agriculture Monitor System (PAMS) is an intelligent system which can monitor the agricultural environments of crops and provides service to farmers. PAMS based on the wireless sensor network (WSN) technique attracts increasing attention in recent years. The purpose of such systems is to improve the outputs of crops by means of managing and monitoring the growth period. This paper presents the design of a WSN for PAMS, shares our real-world experience, and discusses the research and engineering challenges in implementation and deployments.

Internet of Things (IoT) applications rely on networks composed of set of heterogeneous sensors and smart devices, which have the capability to constantly, observe the surroundings and gather data. This heterogeneity is reflected on raw data gathered by such type of systems. Consequently, the task of high-level IoT applications to interpret such data and detect events in the real world is more complex. Moreover, data heterogeneity leads to the lack of interoperability between IoT applications. Semantic Web (SW) technologies have been widely adopted to model and integrate data from different sources on the web; extending them to the IoT domain can be used to mitigate the aforementioned challenges. Semantically annotating IoT data is a fundamental step toward developing smarter and interoperable IoT applications. However, this type of process requires a large amount of computing resources, especially in scenarios where a large number of sensors is expected to be involved such as smart city. To address these challenges, we propose a lightweight semantic annotation approach that can be implemented on resource-constrained IoT gateways connected to a limited number of sensors. To evaluate the feasibility of the proposed approach, we have carried out a set of experimentations using a middleware prototype implementation. Several benchmarks are considered such as: Data size, response time, and resource utilization. c © 2017 The Authors. Published by Elsevier B.V. .

This paper presents challenges and issues in smart buildings and the Internet of Things (IoT), which we identified in years of research in real buildings. To tackle these challenges, a decentralized service-oriented architecture based on a message-oriented middleware has been implemented for the domain of smart buildings. It uses a network-transparent IoT message bus and provides the means for composing applications from auxiliary services, which facilitate device abstraction, protocol adaption, modularity, and maintainability. We demonstrate the flexibility of our architecture by describing how three distinct applications---privacy-enhancing energy data visualization, automated building energy management, and a generic user interface---can be integrated and operated simultaneously in our real smart building laboratory. We compare the advantages of our architecture to conventional ones and provide a best-practice solution for the Intranet of Things and Energy in smart buildings.

Bluetooth technology is now widely used in wireless application systems; however, wireless access service is not involved in BACnet. This paper proposes a design of Bluetooth/BACnet gateway after analyzing the architecture of Bluetooth and BACnet, and gives the implementation of the gateway based on MCU LPC2210(ARM7).


Question: MGNC-CNN: An easy method for utilizing multiple word embeddings in sentence classification.

This paper introduces a novel convolutional neural network architecture, termed the Dynamic Convolutional Neural Network (DCNN), specifically designed for the semantic analysis and representation of sentences. The core feature of the DCNN is its use of Dynamic k-Max Pooling, a global pooling technique that operates over linear sequences, enabling the network to process sentences of varying lengths effectively. This unique approach allows the DCNN to construct a detailed feature graph over the input sentence, thereby facilitating the explicit identification of both short and long-range relationships within the text. Unlike models that depend on syntactic parse trees, the DCNN is language-agnostic, making it readily applicable across different languages without requiring extensive adaptation. To evaluate the DCNN's performance, we conduct a series of experiments. These include binary and multi-class sentiment prediction on a small scale dataset, a six-way question classification task, and sentiment prediction on Twitter data using distant supervision. The DCNN demonstrates superior performance in the initial three evaluations and achieves a significant reduction in error rate—over 25%—in the final task, outperforming the strongest baseline methods.

In this paper, we study, compare and combine two state-of-the-art approaches to automatic feature engineering: Convolution Tree Kernels (CTKs) and Convolutional Neural Networks (CNNs) for learning to rank answer sentences in a Question Answering (QA) setting. When dealing with QA, the key aspect is to encode relational information between the constituents of question and answer in learning algorithms. For this purpose, we propose novel CNNs using relational information and combined them with relational CTKs. The results show that (i) both approaches achieve the state of the art on a question answering task, where CTKs produce higher accuracy and (ii) combining such methods leads to unprecedented high results.

Document-level multi-aspect sentiment classification aims to predict user’s sentiment polarities for different aspects of a product in a review. Existing approaches mainly focus on text information. However, the authors (i.e. users) and overall ratings of reviews are ignored, both of which are proved to be significant on interpreting the sentiments of different aspects in this paper. Therefore, we propose a model called Hierarchical User Aspect Rating Network (HUARN) to consider user preference and overall ratings jointly. Specifically, HUARN adopts a hierarchical architecture to encode word, sentence, and document level information. Then, user attention and aspect attention are introduced into building sentence and document level representation. The document representation is combined with user and overall rating information to predict aspect ratings of a review. Diverse aspects are treated differently and a multi-task framework is adopted. Empirical results on two real-world datasets show that HUARN achieves state-of-the-art performances.

This paper describes two supervised baseline systems for the Story Cloze Test Shared Task (Mostafazadeh et al., 2016a). We first build a classifier using features based on word embeddings and semantic similarity computation. We further implement a neural LSTM system with different encoding strategies that try to model the relation between the story and the provided endings. Our experiments show that a model using representation features based on average word embedding vectors over the given story words and the candidate ending sentences words, joint with similarity features between the story and candidate ending representations performed better than the neural models. Our best model achieves an accuracy of 72.42, ranking 3rd in the official evaluation.

One major deficiency of most semantic representation techniques is that they usually model a word type as a single point in the semantic space, hence conflating all the meanings that the word can have. Addressing this issue by learning distinct representations for individual meanings of words has been the subject of several research studies in the past few years. However, the generated sense representations are either not linked to any sense inventory or are unreliable for infrequent word senses. We propose a technique that tackles these problems by de-conflating the representations of words based on the deep knowledge that can be derived from a semantic network. Our approach provides multiple advantages in comparison to the previous approaches, including its high coverage and the ability to generate accurate representations even for infrequent word senses. We carry out evaluations on six datasets across two semantic similarity tasks and report state-of-the-art results on most of them.

Low-dimensional vector embeddings, computed using LSTMs or simpler techniques, are a popular approach for capturing the “meaning” of text and a form of unsupervised learning useful for downstream tasks. However, their power is not theoretically understood. The current paper derives formal understanding by looking at the subcase of linear embedding schemes. Using the theory of compressed sensing we show that representations combining the constituent word vectors are essentially information-preserving linear measurements of Bag-of-n-Grams (BonG) representations of text. This leads to a new theoretical result about LSTMs: low-dimensional embeddings derived from a low-memory LSTM are provably at least as powerful on classification tasks, up to small error, as a linear classifier over BonG vectors, a result that extensive empirical work has thus far been unable to show. Our experiments support these theoretical findings and establish strong, simple, and unsupervised baselines on standard benchmarks that in some cases are state of the art among word-level methods. We also show a surprising new property of embeddings such as GloVe and word2vec: they form a good sensing matrix for text that is more efficient than random matrices, the standard sparse recovery tool, which may explain why they lead to better representations in practice.

Recent work on learning multilingual word representations usually relies on the use of word-level alignements (e.g. infered with the help of GIZA++) between translated sentences, in order to align the word embeddings in different languages. In this workshop paper, we investigate an autoencoder model for learning multilingual word representations that does without such word-level alignements. The autoencoder is trained to reconstruct the bag-of-word representation of given sentence from an encoded representation extracted from its translation. We evaluate our approach on a multilingual document classification task, where labeled data is available only for one language (e.g. English) while classification must be performed in a different language (e.g. French). In our experiments, we observe that our method compares favorably with a previously proposed method that exploits word-level alignments to learn word representations.

Type-level word embeddings use the same set of parameters to represent all instances of a word regardless of its context, ignoring the inherent lexical ambiguity in language. Instead, we embed semantic concepts (or synsets) as defined in WordNet and represent a word token in a particular context by estimating a distribution over relevant semantic concepts. We use the new, context-sensitive embeddings in a model for predicting prepositional phrase (PP) attachments and jointly learn the concept embeddings and model parameters. We show that using context-sensitive embeddings improves the accuracy of the PP attachment model by 5.4% absolute points, which amounts to a 34.4% relative reduction in errors.

Vectorial representations of words have grown remarkably popular in natural language processing and machine translation. The recent surge in deep learning-inspired methods for producing distributed representations has been widely noted even outside these fields. Existing representations are typically trained on large monolingual corpora using context-based prediction models. In this paper, we propose extending pre-existing word representations by exploiting Wiktionary. This process results in a substantial extension of the original word vector representations, yielding a large multilingual dictionary of word embeddings. We believe that this resource can enable numerous monolingual and cross-lingual applications, as evidenced in a series of monolingual and cross-lingual semantic experiments that we have conducted.

Document level sentiment classification remains a challenge: encoding the intrinsic relations between sentences in the semantic meaning of a document. To address this, we introduce a neural network model to learn vector-based document representation in a unified, bottom-up fashion. The model first learns sentence representation with convolutional neural network or long short-term memory. Afterwards, semantics of sentences and their relations are adaptively encoded in document representation with gated recurrent neural network. We conduct document level sentiment classification on four large-scale review datasets from IMDB and Yelp Dataset Challenge. Experimental results show that: (1) our neural model shows superior performances over several state-of-the-art algorithms; (2) gated recurrent neural network dramatically outperforms standard recurrent neural network in document modeling for sentiment classification.1

We propose a novel method for automatically interpreting compound nouns based on a predefined set of semantic relations. First we map verb tokens in sentential contexts to a fixed set of seed verbs using WordNet::Similarity and Moby’s Thesaurus. We then match the sentences with semantic relations based on the semantics of the seed verbs and grammatical roles of the head noun and modifier. Based on the semantics of the matched sentences, we then build a classifier using TiMBL. The performance of our final system at interpreting NCs is 52.6%.


Question: MGNC-CNN: A straightforward method for utilizing multiple word embeddings in sentence classification.

This paper delves into a sensitivity analysis of Convolutional Neural Networks (CNNs) for sentence classification, providing a practical guide for practitioners. Recent advancements have shown that CNNs can deliver outstanding results in sentence classification tasks (Kim, 2014; Kalchbrenner et al., 2014). However, the selection of the exact model architecture and associated hyperparameters, such as the filter region size and regularization parameters, remains a critical yet understudied aspect. To address this gap, we conduct an in-depth sensitivity analysis on one-layer CNNs to assess how changes in these configurations impact model performance. Our objective is to identify which architectural choices are crucial and which can be considered less significant for sentence classification tasks. By concentrating on one-layer CNNs, we aim to provide a clear understanding and practical guidance, given their proven effectiveness and relative simplicity (Kim, 2014). From our extensive experimental findings, we offer actionable insights for optimizing CNNs for sentence classification. A key takeaway is the necessity for researchers to report performance variances, as they can be significant due to the stochastic nature of initialization and inference processes.

Besides the text content, documents and their associated words usually come with rich sets of meta information, such as categories of documents and semantic/syntactic features of words, like those encoded in word embeddings. Incorporating such meta information directly into the generative process of topic models can improve modelling accuracy and topic quality, especially in the case where the word-occurrence information in the training data is insufficient. In this paper, we present a topic model, called MetaLDA, which is able to leverage either document or word meta information, or both of them jointly. With two data argumentation techniques, we can derive an efficient Gibbs sampling algorithm, which benefits from the fully local conjugacy of the model. Moreover, the algorithm is favoured by the sparsity of the meta information. Extensive experiments on several real world datasets demonstrate that our model achieves comparable or improved performance in terms of both perplexity and topic quality, particularly in handling sparse texts. In addition, compared with other models using meta information, our model runs significantly faster.

Semantic representations have long been argued as potentially useful for enforcing meaning preservation and improving generalization performance of machine translation methods. In this work, we are the first to incorporate information about predicate-argument structure of source sentences (namely, semantic-role representations) into neural machine translation. We use Graph Convolutional Networks (GCNs) to inject a semantic bias into sentence encoders and achieve improvements in BLEU scores over the linguistic-agnostic and syntaxaware versions on the English–German language pair.

We propose two novel model architectures for computing continuous vector representations of words from very large data sets. The quality of these representations is measured in a word similarity task, and the results are compared to the previously best performing techniques based on different types of neural networks. We observe large improvements in accuracy at much lower computational cost, i.e. it takes less than a day to learn high quality word vectors from a 1.6 billion words data set. Furthermore, we show that these vectors provide state-of-the-art performance on our test set for measuring syntactic and semantic word similarities.

Word embeddings provide point representations of words containing useful semantic information. We introduce multimodal word distributions formed from Gaussian mixtures, for multiple word meanings, entailment, and rich uncertainty information. To learn these distributions, we propose an energy-based max-margin objective. We show that the resulting approach captures uniquely expressive semantic information, and outperforms alternatives, such as word2vec skip-grams, and Gaussian embeddings, on benchmark datasets such as word similarity and entailment.

Text embedding has gained a lot of interests in text classification area. This paper investigates the popular neural document embedding method Paragraph Vector as a source of evidence in document ranking. We focus on the effects of combining knowledge-based with knowledge-free document embeddings for text classification task. We concatenate these two representations so that the classification can be done more accurately. The results of our experiments show that this approach achieves better performances on a popular dataset.

We introduce an effective and efficient method that grounds (i.e., localizes) natural sentences in long, untrimmed video sequences. Specifically, a novel Temporal GroundNet (TGN)1 is proposed to temporally capture the evolving fine-grained frame-by-word interactions between video and sentence. TGN sequentially scores a set of temporal candidates ended at each frame based on the exploited frameby-word interactions, and finally grounds the segment corresponding to the sentence. Unlike traditional methods treating the overlapping segments separately in a sliding window fashion, TGN aggregates the historical information and generates the final grounding result in one single pass. We extensively evaluate our proposed TGN on three public datasets with significant improvements over the stateof-the-arts. We further show the consistent effectiveness and efficiency of TGN through an ablation study and a runtime test.

A citing sentence is one that appears in a scientific article and cites previous work. Citing sentences have been studied and used in many applications. For example, they have been used in scientific paper summarization, automatic survey generation, paraphrase identification, and citation function classification. Citing sentences that cite multiple papers are common in scientific writing. This observation should be taken into consideration when using citing sentences in applications. For instance, when a citing sentence is used in a summary of a scientific paper, only the fragments of the sentence that are relevant to the summarized paper should be included in the summary. In this paper, we present and compare three different approaches for identifying the fragments of a citing sentence that are related to a given target reference. Our methods are: word classification, sequence labeling, and segment classification. Our experiments show that segment classification achieves the best results.

The classification of a real text should not be necessarily treated as a binary or multi-class classification, since the text may belong to one or more labels. This type of problem is called multi-label classification. In this paper, we propose the use of latent semantic indexing to text representation, convolutional neural networks to feature extraction and a single multi layer perceptron for multi-label classification in real text data. The experiments show that the model outperforms state of the art techniques when the dataset has long documents, and we observe that the precision is poor when the size of the texts is small.

In this paper, we propose a sequential neural encoder with latent structured description SNELSD for modeling sentences. This model introduces latent chunk-level representations into conventional sequential neural encoders, i.e., recurrent neural networks with long short-term memory LSTM units, to consider the compositionality of languages in semantic modeling. An SNELSD model has a hierarchical structure that includes a detection layer and a description layer. The detection layer predicts the boundaries of latent word chunks in an input sentence and derives a chunk-level vector for each word. The description layer utilizes modified LSTM units to process these chunk-level vectors in a recurrent manner and produces sequential encoding outputs. These output vectors are further concatenated with word vectors or the outputs of a chain LSTM encoder to obtain the final sentence representation. All the model parameters are learned in an end-to-end manner without a dependency on additional text chunking or syntax parsing. A natural language inference task and a sentiment analysis task are adopted to evaluate the performance of our proposed model. The experimental results demonstrate the effectiveness of the proposed SNELSD model on exploring task-dependent chunking patterns during the semantic modeling of sentences. Furthermore, the proposed method achieves better performance than conventional chain LSTMs and tree-structured LSTMs on both tasks.

There are two main types of word representations: low-dimensional embeddings and high-dimensional distributional vectors, in which each dimension corresponds to a context word. In this paper, we initialize an embedding-learning model with distributional vectors. Evaluation on word similarity shows that this initialization significantly increases the quality of embeddings for rare words.


Question: MGNC-CNN: A straightforward method for utilizing multiple word embeddings in sentence classification.

This paper introduces a novel model, Global Vectors for Word Representation (GloVe), which excels in capturing nuanced semantic and syntactic patterns through vector arithmetic, while elucidating the underlying mechanisms that facilitate such regularities. Through a rigorous analysis, we identify the key model attributes essential for the emergence of these patterns within word vectors. Drawing on these insights, we propose a fresh global log-bilinear regression model that amalgamates the strengths of the two dominant model paradigms in the field: global matrix factorization and local context window techniques. Our approach optimizes the use of statistical data by focusing the training process exclusively on the non-zero elements within a word-word co-occurrence matrix, instead of the entire sparse matrix or individual context windows across a vast corpus. This targeted approach yields a vector space with a rich, meaningful substructure, as evidenced by its impressive 75% accuracy on a recent word analogy task. Moreover, the model outperforms its counterparts in similarity assessments and named entity recognition, showcasing its superior performance across a range of linguistic tasks.

Tagging news articles or blog posts with relevant tags from a collection of predefined ones is coined as document tagging in this work. Accurate tagging of articles can benefit several downstream applications such as recommendation and search. In this work, we propose a novel yet simple approach called DocTag2Vec to accomplish this task. We substantially extend Word2Vec and Doc2Vec—two popular models for learning distributed representation of words and documents. In DocTag2Vec, we simultaneously learn the representation of words, documents, and tags in a joint vector space during training, and employ the simple k-nearest neighbor search to predict tags for unseen documents. In contrast to previous multi-label learning methods, DocTag2Vec directly deals with raw text instead of provided feature vector, and in addition, enjoys advantages like the learning of tag representation, and the ability of handling newly created tags. To demonstrate the effectiveness of our approach, we conduct experiments on several datasets and show promising results against state-of-the-art methods.

We introduce an effective and efficient method that grounds (i.e., localizes) natural sentences in long, untrimmed video sequences. Specifically, a novel Temporal GroundNet (TGN)1 is proposed to temporally capture the evolving fine-grained frame-by-word interactions between video and sentence. TGN sequentially scores a set of temporal candidates ended at each frame based on the exploited frameby-word interactions, and finally grounds the segment corresponding to the sentence. Unlike traditional methods treating the overlapping segments separately in a sliding window fashion, TGN aggregates the historical information and generates the final grounding result in one single pass. We extensively evaluate our proposed TGN on three public datasets with significant improvements over the stateof-the-arts. We further show the consistent effectiveness and efficiency of TGN through an ablation study and a runtime test.

Natural language generation of coherent long texts like paragraphs or longer documents is a challenging problem for recurrent networks models. In this paper, we explore an important step toward this generation task: training an LSTM (Longshort term memory) auto-encoder to preserve and reconstruct multi-sentence paragraphs. We introduce an LSTM model that hierarchically builds an embedding for a paragraph from embeddings for sentences and words, then decodes this embedding to reconstruct the original paragraph. We evaluate the reconstructed paragraph using standard metrics like ROUGE and Entity Grid, showing that neural models are able to encode texts in a way that preserve syntactic, semantic, and discourse coherence. While only a first step toward generating coherent text units from neural models, our work has the potential to significantly impact natural language generation and summarization1.

Word representations have proven useful for many NLP tasks, e.g., Brown clusters as features in dependency parsing (Koo et al., 2008). In this paper, we investigate the use of continuous word representations as features for dependency parsing. We compare several popular embeddings to Brown clusters, via multiple types of features, in both news and web domains. We find that all embeddings yield significant parsing gains, including some recent ones that can be trained in a fraction of the time of others. Explicitly tailoring the representations for the task leads to further improvements. Moreover, an ensemble of all representations achieves the best results, suggesting their complementarity.

Across the globe, people are voicing their opinion in social media and various other online fora. Given such data, modern deep learning-based sentiment analysis methods excel at determining the sentiment polarity of what is being said about companies, products, etc. Unfortunately, such deep methods require significant training data, while for many languages, resources and training data are scarce. In this work, we present a cross-lingual propagation algorithm that yields sentiment embedding vectors for numerous languages. We then rely on a dual-channel convolutional neural architecture to incorporate them into the network. This allows us to achieve gains in deep sentiment analysis across a range of languages and domains.

Word embedding maps words into a lowdimensional continuous embedding space by exploiting the local word collocation patterns in a small context window. On the other hand, topic modeling maps documents onto a low-dimensional topic space, by utilizing the global word collocation patterns in the same document. These two types of patterns are complementary. In this paper, we propose a generative topic embedding model to combine the two types of patterns. In our model, topics are represented by embedding vectors, and are shared across documents. The probability of each word is influenced by both its local context and its topic. A variational inference method yields the topic embeddings as well as the topic mixing proportions for each document. Jointly they represent the document in a low-dimensional continuous space. In two document classification tasks, our method performs better than eight existing methods, with fewer features. In addition, we illustrate with an example that our method can generate coherent topics even based on only one document.

In this paper, we propose a method to classify movie review documents into positive or negative opinions. There are several approaches to classify documents. The previous studies, however, used only a single classifier for the classification task. We describe a multiple classifier for the review document classification task. The method consists of three classifiers based on SVMs, ME and score calculation. We apply two voting methods and SVMs to the integration process of single classifiers. The integrated methods improved the accuracy as compared with the three single classifiers. The experimental results show the effectiveness of our method.

In this paper we describe a work in progress on designing the continuous vector space word representations able to map unseen data adequately. We propose a LSTM-based feature extraction layer that reads in a sequence of characters corresponding to a word and outputs a single fixed-length real-valued vector. We then test our model on a POS tagging task on four typologically different languages. The results of the experiments suggest that the model can offer a solution to the out-of-vocabulary words problem, as in a comparable setting its OOV accuracy improves over that of a state of the art tagger.

How to model a pair of sentences is a critical issue in many NLP tasks such as answer selection (AS), paraphrase identification (PI) and textual entailment (TE). Most prior work (i) deals with one individual task by fine-tuning a specific system; (ii) models each sentence’s representation separately, rarely considering the impact of the other sentence; or (iii) relies fully on manually designed, task-specific linguistic features. This work presents a general Attention Based Convolutional Neural Network (ABCNN) for modeling a pair of sentences. We make three contributions. (i) The ABCNN can be applied to a wide variety of tasks that require modeling of sentence pairs. (ii) We propose three attention schemes that integrate mutual influence between sentences into CNNs; thus, the representation of each sentence takes into consideration its counterpart. These interdependent sentence pair representations are more powerful than isolated sentence representations. (iii) ABCNNs achieve state-of-the-art performance on AS, PI and TE tasks. We release code at: https://github.com/yinwenpeng/Answer_Selection.

The set of features which the traditional feature selection algorithm of chi-square selected is not complete. This causes the low performance for the final text classification. Therefore, this paper proposes a method. The method utilizes word2vec to generate word vector to improve feature selection algorithm of the chi square. The algorithm applies the word vector generated by word2vec to the process of the traditional feature selection and uses these words to supplement the set of features as appropriate. Ultimately, the set of features obtained by this method has better discriminatory power. Because, the feature words with the better discriminatory power has the strong ability of distinguishing categories as its semantically similar words. On this base, multiple experiments have been carried out in this paper. The experimental results show that the performance of text classification can increase after extension of feature words.


Question: MGNC-CNN: An easy method for utilizing multiple word embeddings in sentence classification.

This study explores the efficacy of convolutional neural networks (CNN) in conjunction with pre-trained word vectors for the purpose of sentence classification. Through a series of experiments, we demonstrate that even a rudimentary CNN, without extensive hyperparameter tuning and utilizing static word vectors, can yield impressive results on various benchmarks. The performance can be further enhanced by fine-tuning the word vectors specifically for the learning task at hand. To facilitate the integration of both task-specific and static vectors, we introduce a slight architectural adjustment to the CNN. The proposed CNN models, with their improved handling of word embeddings, surpass previous state-of-the-art results in 4 out of 7 tasks, encompassing sentiment analysis and question classification. This approach, coined MGNC-CNN, offers a straightforward yet powerful method for exploiting multiple word embeddings in sentence classification tasks, demonstrating its versatility and effectiveness across diverse linguistic analyses.

Recent studies have been revisiting whole words as the basic modelling unit in speech recognition and query applications, instead of phonetic units. Such whole-word segmental systems rely on a function that maps a variable-length speech segment to a vector in a fixed-dimensional space; the resulting acoustic word embeddings need to allow for accurate discrimination between different word types, directly in the embedding space. We compare several old and new approaches in a word discrimination task. Our best approach uses side information in the form of known word pairs to train a Siamese convolutional neural network (CNN): a pair of tied networks that take two speech segments as input and produce their embeddings, trained with a hinge loss that separates same-word pairs and different-word pairs by some margin. A word classifier CNN performs similarly, but requires much stronger supervision. Both types of CNNs yield large improvements over the best previously published results on the word discrimination task.

Vectorial representations of words have grown remarkably popular in natural language processing and machine translation. The recent surge in deep learning-inspired methods for producing distributed representations has been widely noted even outside these fields. Existing representations are typically trained on large monolingual corpora using context-based prediction models. In this paper, we propose extending pre-existing word representations by exploiting Wiktionary. This process results in a substantial extension of the original word vector representations, yielding a large multilingual dictionary of word embeddings. We believe that this resource can enable numerous monolingual and cross-lingual applications, as evidenced in a series of monolingual and cross-lingual semantic experiments that we have conducted.

Recently, knowledge graph embedding, which projects symbolic entities and relations into continuous vector space, has become a new, hot topic in artificial intelligence. This paper proposes a novel generative model (TransG) to address the issue of multiple relation semantics that a relation may have multiple meanings revealed by the entity pairs associated with the corresponding triples. The new model can discover latent semantics for a relation and leverage a mixture of relationspecific component vectors to embed a fact triple. To the best of our knowledge, this is the first generative model for knowledge graph embedding, and at the first time, the issue of multiple relation semantics is formally discussed. Extensive experiments show that the proposed model achieves substantial improvements against the state-of-the-art baselines.

Single-word vector space models have been very successful at learning lexical information. However, they cannot capture the compositional meaning of longer phrases, preventing them from a deeper understanding of language. We introduce a recursive neural network (RNN) model that learns compositional vector representations for phrases and sentences of arbitrary syntactic type and length. Our model assigns a vector and a matrix to every node in a parse tree: the vector captures the inherent meaning of the constituent, while the matrix captures how it changes the meaning of neighboring words or phrases. This matrix-vector RNN can learn the meaning of operators in propositional logic and natural language. The model obtains state of the art performance on three different experiments: predicting fine-grained sentiment distributions of adverb-adjective pairs; classifying sentiment labels of movie reviews and classifying semantic relationships such as cause-effect or topic-message between nouns using the syntactic path between them.

Current supervised parsers are limited by the size of their labelled training data, making improving them with unlabelled data an important goal. We show how a state-of-the-art CCG parser can be enhanced, by predicting lexical categories using unsupervised vector-space embeddings of words. The use of word embeddings enables our model to better generalize from the labelled data, and allows us to accurately assign lexical categories without depending on a POS-tagger. Our approach leads to substantial improvements in dependency parsing results over the standard supervised CCG parser when evaluated on Wall Street Journal (0.8%), Wikipedia (1.8%) and biomedical (3.4%) text. We compare the performance of two recently proposed approaches for classification using a wide variety of word embeddings. We also give a detailed error analysis demonstrating where using embeddings outperforms traditional feature sets, and showing how including POS features can decrease accuracy.

In this paper, we proposed a sentence encoding-based model for recognizing text entailment. In our approach, the encoding of sentence is a two-stage process. Firstly, average pooling was used over word-level bidirectional LSTM (biLSTM) to generate a firststage sentence representation. Secondly, attention mechanism was employed to replace average pooling on the same sentence for better representations. Instead of using target sentence to attend words in source sentence, we utilized the sentence’s first-stage representation to attend words appeared in itself, which is called ”Inner-Attention” in our paper . Experiments conducted on Stanford Natural Language Inference (SNLI) Corpus has proved the effectiveness of ”Inner-Attention” mechanism. With less number of parameters, our model outperformed the existing best sentence encoding-based approach by a large margin.

We propose a novel method for automatically interpreting compound nouns based on a predefined set of semantic relations. First we map verb tokens in sentential contexts to a fixed set of seed verbs using WordNet::Similarity and Moby’s Thesaurus. We then match the sentences with semantic relations based on the semantics of the seed verbs and grammatical roles of the head noun and modifier. Based on the semantics of the matched sentences, we then build a classifier using TiMBL. The performance of our final system at interpreting NCs is 52.6%.

Deep learning yields great results across many fields, from speech recognition, image classification, to translation. But for each problem, getting a deep model to work well involves research into the architecture and a long period of tuning. We present a single model that yields good results on a number of problems spanning multiple domains. In particular, this single model is trained concurrently on ImageNet, multiple translation tasks, image captioning (COCO dataset), a speech recognition corpus, and an English parsing task. Our model architecture incorporates building blocks from multiple domains. It contains convolutional layers, an attention mechanism, and sparsely-gated layers. Each of these computational blocks is crucial for a subset of the tasks we train on. Interestingly, even if a block is not crucial for a task, we observe that adding it never hurts performance and in most cases improves it on all tasks. We also show that tasks with less data benefit largely from joint training with other tasks, while performance on large tasks degrades only slightly if at all.

The caption retrieval task can be defined as follows: given a set of images I and a set of describing sentences S, for each image i in I we ought to find the sentence in S that best describes i. The most commonly applied method to solve this problem is to build a multimodal space and to map each image and each sentence to that space, so that they can be compared easily. A non-conventional model called Word2VisualVec has been proposed recently: instead of mapping images and sentences to a multimodal space, they mapped sentences directly to a space of visual features. Advances in the computation of visual features let us infer that such an approach is promising. In this paper, we propose a new Recurrent Neural Network model following that unconventional approach based on Gated Recurrent Capsules (GRCs), designed as an extension of Gated Recurrent Units (GRUs). We show that GRCs outperform GRUs on the caption retrieval task. We also state that GRCs present a great potential for other applications.

Automatic abstractive text summarization is an important and challenging research topic of natural language processing. Among many widely used languages, the Chinese language has a special property that a Chinese character contains rich information comparable to a word. Existing Chinese text summarization methods, either adopt totally character-based or word-based representations, fail to fully exploit the information carried by both representations. To accurately capture the essence of articles, we propose a hybrid word-character approach (HWC) which preserves the advantages of both wordbased and character-based representations. We evaluate the advantage of the proposed HWC approach by applying it to two existing methods, and discover that it generates state-of-the-art performance with a margin of 24 ROUGE points on a widely used dataset LCSTS. In addition, we find an issue contained in the LCSTS dataset and offer a script to remove overlapping pairs (a summary and a short text) to create a clean dataset for the community. The proposed HWC approach also generates the best performance on the new, clean LCSTS dataset.


Question: MGNC-CNN: A straightforward method for utilizing multiple word embeddings in sentence classification.

This study explores the application of Convolutional Neural Networks (CNNs) in text categorization, focusing on harnessing the one-dimensional structure of text data, specifically word order, for enhanced prediction accuracy. Unlike conventional approaches that rely on low-dimensional word vectors, we apply CNN directly to high-dimensional textual information. This methodology enables the direct learning of embeddings for small text segments, which are then utilized for classification purposes. Beyond a standard adaptation of CNN from image to text processing, we introduce a novel variation that incorporates bag-of-words conversion within the convolutional layer. Furthermore, we investigate the integration of multiple convolutional layers to achieve higher classification accuracy. Experimental results highlight the superior performance of our proposed approach when compared to leading methods in the field.

We describe a simple neural language model that relies only on character-level inputs. Predictions are still made at the word-level. Our model employs a convolutional neural network (CNN) and a highway network over characters, whose output is given to a long shortterm memory (LSTM) recurrent neural network language model (RNN-LM). On the English Penn Treebank the model is on par with the existing state-ofthe-art despite having 60% fewer parameters. On languages with rich morphology (Czech, German, French, Spanish, Russian), the model consistently outperforms a Kneser-Ney baseline and word-level/morpheme-level LSTM baselines, again with far fewer parameters. Our results suggest that on many languages, character inputs are sufficient for language modeling.

The caption retrieval task can be defined as follows: given a set of images I and a set of describing sentences S, for each image i in I we ought to find the sentence in S that best describes i. The most commonly applied method to solve this problem is to build a multimodal space and to map each image and each sentence to that space, so that they can be compared easily. A non-conventional model called Word2VisualVec has been proposed recently: instead of mapping images and sentences to a multimodal space, they mapped sentences directly to a space of visual features. Advances in the computation of visual features let us infer that such an approach is promising. In this paper, we propose a new Recurrent Neural Network model following that unconventional approach based on Gated Recurrent Capsules (GRCs), designed as an extension of Gated Recurrent Units (GRUs). We show that GRCs outperform GRUs on the caption retrieval task. We also state that GRCs present a great potential for other applications.

Word representations have proven useful for many NLP tasks, e.g., Brown clusters as features in dependency parsing (Koo et al., 2008). In this paper, we investigate the use of continuous word representations as features for dependency parsing. We compare several popular embeddings to Brown clusters, via multiple types of features, in both news and web domains. We find that all embeddings yield significant parsing gains, including some recent ones that can be trained in a fraction of the time of others. Explicitly tailoring the representations for the task leads to further improvements. Moreover, an ensemble of all representations achieves the best results, suggesting their complementarity.

Recently, many NLP tasks have benefited from distributed word representation. However, it remains unknown whether embedding models are really immune to the typological diversity of languages, despite the language-independent architecture. Here we investigate three representative models on a large set of language samples by mapping dense embedding to sparse linguistic property space. Experiment results reveal the language universal and specific properties encoded in various word representation. Additionally, strong evidence supports the utility of word form, especially for inflectional languages.

Attention mechanism has been a key component in Recurrent Neural Networks (RNNs) based sequence to sequence learning framework, which has been adopted in many text understanding tasks, such as neural machine translation and abstractive summarization. In these tasks, the attention mechanism models how important each part of the source sentence is to generate a target side word. To compute such importance scores, the attention mechanism summarizes the source side information in the encoder RNN hidden states (i.e., ht), and then builds a context vector for a target side word upon a subsequence representation of the source sentence, since ht actually summarizes the information of the subsequence containing the first t-th words in the source sentence. We in this paper, show that an additional attention mechanism called word attention, that builds itself upon word level representations, significantly enhances the performance of sequence to sequence learning. Our word attention can enrich the source side contextual representation by directly promoting the clean word level information in each step. Furthermore, we propose to use contextual gates to dynamically combine the subsequence level and word level contextual information. Experimental results on abstractive summarization and neural machine translation show that word attention significantly improve over strong baselines. In particular, we achieve the state-of-the-art result on WMT’14 English-French translation task with 12M training data.

We describe a neural network model that jointly learns distributed representations of texts and knowledge base (KB) entities. Given a text in the KB, we train our proposed model to predict entities that are relevant to the text. Our model is designed to be generic with the ability to address various NLP tasks with ease. We train the model using a large corpus of texts and their entity annotations extracted from Wikipedia. We evaluated the model on three important NLP tasks (i.e., sentence textual similarity, entity linking, and factoid question answering) involving both unsupervised and supervised settings. As a result, we achieved state-of-the-art results on all three of these tasks. Our code and trained models are publicly available for further academic research.

In this project, we exploit several deep learning architectures in Question Answering field, based on the newly released Stanford Question Answering dataset (SQuAD)[7]. We introduce a multi-stage process that encodes context paragraphs at different levels of granularity, uses co-attention mechanism to fuse representations of questions and context paragraphs, and finally decodes the co-attention vectors to get the answers. Our best model gets 62.23% F1 score and 48.72% EM score on the test set.

We present a family of neural-network– inspired models for computing continuous word representations, specifically designed to exploit both monolingual and multilingual text. This framework allows us to perform unsupervised training of embeddings that exhibit higher accuracy on syntactic and semantic compositionality, as well as multilingual semantic similarity, compared to previous models trained in an unsupervised fashion. We also show that such multilingual embeddings, optimized for semantic similarity, can improve the performance of statistical machine translation with respect to how it handles words not present in the parallel data.

The classification of a real text should not be necessarily treated as a binary or multi-class classification, since the text may belong to one or more labels. This type of problem is called multi-label classification. In this paper, we propose the use of latent semantic indexing to text representation, convolutional neural networks to feature extraction and a single multi layer perceptron for multi-label classification in real text data. The experiments show that the model outperforms state of the art techniques when the dataset has long documents, and we observe that the precision is poor when the size of the texts is small.

How to model a pair of sentences is a critical issue in many NLP tasks such as answer selection (AS), paraphrase identification (PI) and textual entailment (TE). Most prior work (i) deals with one individual task by fine-tuning a specific system; (ii) models each sentence’s representation separately, rarely considering the impact of the other sentence; or (iii) relies fully on manually designed, task-specific linguistic features. This work presents a general Attention Based Convolutional Neural Network (ABCNN) for modeling a pair of sentences. We make three contributions. (i) The ABCNN can be applied to a wide variety of tasks that require modeling of sentence pairs. (ii) We propose three attention schemes that integrate mutual influence between sentences into CNNs; thus, the representation of each sentence takes into consideration its counterpart. These interdependent sentence pair representations are more powerful than isolated sentence representations. (iii) ABCNNs achieve state-of-the-art performance on AS, PI and TE tasks. We release code at: https://github.com/yinwenpeng/Answer_Selection.